Apr 13 17:17:03 devstack cinder-volume[72286]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 17:17:03 devstack cinder-volume[72286]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 17:17:03 devstack cinder-volume[72286]: we strongly recommend against using it for new projects. Apr 13 17:17:03 devstack cinder-volume[72286]: If you are already using Eventlet, we recommend migrating to a different Apr 13 17:17:03 devstack cinder-volume[72286]: framework. For more detail see Apr 13 17:17:03 devstack cinder-volume[72286]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 17:17:03 devstack cinder-volume[72286]: import eventlet # noqa Apr 13 17:17:05 devstack cinder-volume[72286]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72286) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:17:05 devstack cinder-volume[72286]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72286) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:17:05 devstack cinder-volume[72286]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72286) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:17:05 devstack cinder-volume[72286]: INFO dbcounter [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Registered counter for database cinder Apr 13 17:17:05 devstack cinder-volume[72286]: DEBUG oslo_db.sqlalchemy.engines [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:17:05 devstack cinder-volume[72286]: DEBUG dbcounter [-] [72286] Writer thread running {{(pid=72286) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 17:17:05 devstack cinder-volume[72286]: INFO cinder.rpc [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 17:17:05 devstack cinder-volume[72286]: INFO cinder.rpc [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 17:17:05 devstack cinder-volume[72286]: DEBUG oslo_db.sqlalchemy.engines [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:17:05 devstack cinder-volume[72286]: INFO cinder.volume.manager [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Determined volume DB was empty at startup. Apr 13 17:17:05 devstack cinder-volume[72286]: DEBUG cinder.volume.manager [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72286) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 17:17:06 devstack cinder-volume[72286]: INFO cinder.volume.manager [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 13 17:17:06 devstack cinder-volume[72286]: WARNING stevedore.named [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 17:17:06 devstack cinder-volume[72286]: WARNING castellan.key_manager [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:17:06 devstack cinder-volume[72286]: WARNING cinder.keymgr.conf_key_mgr [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG cinder.volume.drivers.lvm [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72286) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_concurrency.processutils [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72286) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_concurrency.processutils [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] CMD "cinder-rtstool verify" returned: 0 in 0.227s {{(pid=72286) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_db.sqlalchemy.engines [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:17:06 devstack cinder-volume[72286]: INFO cinder.rpc [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 13 17:17:06 devstack cinder-volume[72286]: INFO cinder.rpc [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 13 17:17:06 devstack cinder-volume[72286]: WARNING stevedore.named [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 17:17:06 devstack cinder-volume[72286]: WARNING castellan.key_manager [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:17:06 devstack cinder-volume[72286]: INFO cinder.volume.manager [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_db.sqlalchemy.engines [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:17:06 devstack cinder-volume[72286]: INFO oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Starting 1 workers Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Started child 72391 {{(pid=72286) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Full set of CONF: {{(pid=72286) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] ******************************************************************************** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Configuration options gathered from: {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] ================================================================================ {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] allow_availability_zone_fallback = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] allow_compression_on_image_upload = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] allowed_direct_url_schemes = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] api_rate_limit = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] auth_strategy = keystone {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] az_cache_duration = 3600 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_availability_zone = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_host = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_stats_polling_interval = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backup_api_class = cinder.backup.api.API {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backup_name_template = backup-%s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backup_use_same_host = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backup_use_temp_snapshot = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] chap_password = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72391]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] chap_username = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cinder_internal_tenant_project_id = 13f38e929ce646809e21d456e6382b95 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cinder_internal_tenant_user_id = 775754842e0740da83f49a52b00b07eb {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cloned_volume_same_az = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cluster = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] compression_format = gzip {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] compute_api_class = cinder.compute.nova.API {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] config_dir = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] config_source = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] control_exchange = openstack {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] debug = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] default_availability_zone = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] default_group_type = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] default_volume_type = lvmdriver-1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] disk_geometry = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] driver_client_cert = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] driver_client_cert_key = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] driver_data_namespace = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] driver_ssl_cert_path = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] driver_ssl_cert_verify = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] driver_use_ssl = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] enable_force_upload = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] enable_new_services = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] enable_unsupported_driver = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] enforce_multipath_for_image_xfer = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] filter_function = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance_api_insecure = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance_api_servers = ['http://192.168.122.27/image'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance_api_ssl_compression = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance_ca_certificates_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance_catalog_info = image:glance:publicURL {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance_certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance_keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance_num_retries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance_request_timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] goodness_function = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] graceful_shutdown_timeout = 5 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] group_api_class = cinder.group.api.API {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] host = devstack {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] image_compress_on_upload = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] image_conversion_address_space_limit = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] image_conversion_cpu_limit = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] image_conversion_disable = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] image_upload_use_cinder_backend = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] image_upload_use_internal_tenant = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] image_volume_cache_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] image_volume_cache_max_count = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] image_volume_cache_max_size_gb = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] init_host_max_objects_retrieval = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] instance_format = [instance: %(uuid)s] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] iscsi_target_flags = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] iscsi_write_cache = on {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] iser_helper = tgtadm {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] iser_ip_address = 192.168.122.27 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] iser_port = 3260 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] log_color = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] log_config_append = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] log_dir = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] log_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] log_options = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] log_rotate_interval = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] log_rotate_interval_type = days {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] log_rotation_type = none {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] max_age = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] max_logfile_count = 30 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] max_logfile_size_mb = 200 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] max_over_subscription_ratio = 20.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] message_reap_interval = 86400 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] message_ttl = 2592000 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] migration_create_volume_timeout_secs = 300 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] monkey_patch = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] monkey_patch_modules = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] my_ip = 192.168.122.27 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] no_snapshot_gb_quota = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] num_iser_scan_tries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] num_shell_tries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] num_volume_device_scan_tries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] nvmeof_conn_info_version = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] nvmet_ns_id = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] nvmet_port_id = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] osapi_max_limit = 1000 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] osapi_volume_ext_list = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] osapi_volume_listen_port = 8776 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] osapi_volume_use_ssl = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] osapi_volume_workers = 2 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] per_volume_size_limit = -1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] periodic_fuzzy_delay = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] periodic_interval = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] public_endpoint = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] publish_errors = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] quota_backup_gigabytes = 1000 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] quota_backups = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] quota_gigabytes = 1000 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] quota_groups = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] quota_snapshots = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] quota_volumes = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] rate_limit_burst = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] rate_limit_except_level = CRITICAL {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] rate_limit_interval = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] reinit_driver_count = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] replication_device = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] report_discard_supported = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] report_interval = 120 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] reservation_clean_interval = 86400 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] reservation_expire = 86400 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] reserved_image_namespaces = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] reserved_percentage = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] rpc_response_timeout = 120 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] run_external_periodic_tasks = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] scst_target_driver = iscsi {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] scst_target_iqn_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] service_down_time = 720 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] shell_completion = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] snapshot_name_template = snapshot-%s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] snapshot_same_host = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] split_loggers = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] state_path = /opt/stack/data/cinder {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] storage_availability_zone = nova {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] storage_protocol = iSCSI {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] syslog_log_facility = LOG_USER {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] target_helper = lioadm {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] target_ip_address = 192.168.122.27 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] target_port = 3260 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] target_protocol = iscsi {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] target_secondary_ip_addresses = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] trace_flags = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] transport_url = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] until_refresh = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] use_chap_auth = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] use_default_quota_class = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] use_journal = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] use_json = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] use_multipath_for_image_xfer = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] use_stderr = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] use_syslog = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] verify_glance_signatures = enabled {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volume_api_class = cinder.volume.api.API {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volume_backend_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volume_clear = zero {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volume_clear_ionice = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volume_clear_size = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volume_copy_bps_limit = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volume_dd_blocksize = 1M {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volume_name_template = volume-%s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volume_service_inithost_offload = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volume_usage_audit_period = month {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] zoning_mode = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_concurrency.disable_process_locking = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.admin_password = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.admin_token = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.admin_user = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.auth_port = 35357 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.auth_protocol = https {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.auth_section = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.auth_type = password {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.auth_uri = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.auth_version = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.cache = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.identity_uri = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.include_service_catalog = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.insecure = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.interface = public {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_password = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcache_username = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.region_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.service_type = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.27/identity {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.backend = dogpile.cache.null {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.backend_argument = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.backend_expiration_time = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.config_prefix = cache.oslo {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.debug_cache_backend = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.enable_retry_client = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.enable_socket_keepalive = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.enforce_fips_mode = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.expiration_time = 600 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.hashclient_retry_attempts = 2 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.memcache_dead_retry = 300 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.memcache_pool_maxsize = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.memcache_sasl_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.password = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.proxies = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.redis_db = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.redis_server = localhost:6379 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.retry_attempts = 2 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.retry_delay = 0.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.socket_keepalive_count = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.socket_keepalive_idle = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.socket_keepalive_interval = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.socket_timeout = 1.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.tls_allowed_ciphers = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.tls_cafile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.tls_certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.tls_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.tls_keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cache.username = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] coordination.backend_url = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.asyncio_connection = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.asyncio_slave_connection = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.backend = sqlalchemy {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.connection = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.connection_debug = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.connection_parameters = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.connection_recycle_time = 3600 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.connection_trace = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.db_inc_retry_interval = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.db_max_retries = 20 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.db_max_retry_interval = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.db_retry_interval = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.max_overflow = 50 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.max_pool_size = 5 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.max_retries = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.mysql_wsrep_sync_wait = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.pool_timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.retry_interval = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.slave_connection = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.sqlite_synchronous = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.synchronous_reader = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] database.use_db_reconnect = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler.connection_string = messaging:// {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler.enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler.es_doc_type = notification {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler.es_scroll_size = 10000 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler.es_scroll_time = 2m {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler.filter_error_trace = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler.hmac_keys = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler.sentinel_service_name = mymaster {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler.socket_timeout = 0.1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler.trace_requests = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler.trace_sqlalchemy = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler_jaeger.process_tags = {} {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler_jaeger.service_name_prefix = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] profiler_otlp.service_name_prefix = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_policy.enforce_new_defaults = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: WARNING oslo_config.cfg [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_policy.enforce_scope = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_policy.policy_default_rule = default {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_policy.policy_file = policy.yaml {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] privsep_osbrick.group = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] privsep_osbrick.helper_command = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] privsep_osbrick.user = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cinder_sys_admin.group = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cinder_sys_admin.helper_command = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] cinder_sys_admin.user = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] service_user.auth_section = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] service_user.auth_type = password {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] service_user.cafile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] service_user.certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] service_user.collect_timing = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] service_user.insecure = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] service_user.keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] service_user.send_service_user_token = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] service_user.split_loggers = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] service_user.timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance.auth_section = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance.auth_type = password {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance.certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance.collect_timing = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance.insecure = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance.keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance.region_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance.split_loggers = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] glance.timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.backend_availability_zone = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.chap_password = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.chap_username = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.disk_geometry = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.driver_client_cert = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.driver_client_cert_key = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.driver_data_namespace = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.driver_use_ssl = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.extra_capabilities = {} {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.filter_function = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.goodness_function = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.iscsi_target_flags = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.iscsi_write_cache = on {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.iser_helper = tgtadm {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.iser_ip_address = 192.168.122.27 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.iser_port = 3260 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.lvm_share_target = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.lvm_type = auto {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.num_shell_tries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.replication_device = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.report_discard_supported = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.reserved_percentage = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.target_helper = tgtadm {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.target_ip_address = 192.168.122.27 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.target_port = 3260 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.target_protocol = iscsi {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.trace_flags = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.unique_fqdn_network = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.use_chap_auth = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.volume_backend_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.volume_clear = zero {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.volume_clear_ionice = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.volume_clear_size = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_reports.file_event_handler = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_reports.log_dir = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.backend_host = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.chap_password = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.chap_username = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.disk_geometry = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.driver_client_cert = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.extra_capabilities = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.filter_function = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.goodness_function = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.iser_helper = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.iser_ip_address = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.iser_port = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.lvm_share_target = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.lvm_type = auto {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.num_shell_tries = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.replication_device = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.report_discard_supported = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.reserved_percentage = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.scst_target_driver = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.storage_protocol = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.target_helper = lioadm {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.target_ip_address = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.target_port = 3260 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.trace_flags = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.use_chap_auth = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.volume_clear = zero {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.volume_clear_size = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] lvmdriver-1.volumes_dir = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.ssl = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_notifications.driver = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_notifications.retry = -1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] key_manager.fixed_key = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72391]: INFO cinder.volume.manager [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.barbican_api_version = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.barbican_endpoint = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.barbican_endpoint_type = public {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.barbican_region_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.cafile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.collect_timing = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.insecure = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.number_of_retries = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.retry_delay = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.send_service_user_token = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.split_loggers = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.verify_ssl = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican.verify_ssl_path = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican_service_user.auth_section = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican_service_user.auth_type = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican_service_user.cafile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican_service_user.certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican_service_user.collect_timing = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican_service_user.insecure = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican_service_user.keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican_service_user.split_loggers = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] barbican_service_user.timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] vault.approle_role_id = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] vault.approle_secret_id = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] vault.kv_mountpoint = secret {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] vault.kv_path = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] vault.kv_version = 2 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] vault.namespace = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] vault.root_token_id = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] vault.ssl_ca_crt_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] vault.timeout = 60.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] vault.use_ssl = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:17:06 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] ******************************************************************************** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 17:17:06 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:06 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:06 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:06 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:06 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:06 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:06 devstack sudo[72396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 13 17:17:06 devstack sudo[72396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:07 devstack sudo[72396]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:07 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.519s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:07 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:07 devstack sudo[72489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:17:07 devstack sudo[72489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:07 devstack sudo[72489]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:07 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.501s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:07 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:17:07 devstack cinder-volume[72391]: INFO cinder.brick.local_dev.lvm [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 13 17:17:07 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:07 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:07 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:07 devstack sudo[72729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:17:07 devstack sudo[72729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:08 devstack sudo[72729]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:08 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.528s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:08 devstack cinder-volume[72391]: DEBUG cinder.brick.local_dev.lvm [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72391) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 13 17:17:08 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:08 devstack sudo[72888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:17:08 devstack sudo[72888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:09 devstack sudo[72888]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:09 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.931s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:09 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:09 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:09 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:09 devstack sudo[73051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:17:09 devstack sudo[73051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:09 devstack sudo[73051]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:09 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.477s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:09 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:09 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:09 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:09 devstack sudo[73092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 13 17:17:09 devstack sudo[73092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:10 devstack sudo[73092]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:10 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.462s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:10 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:10 devstack sudo[73096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:17:10 devstack sudo[73096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:10 devstack sudo[73096]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:10 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:10 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:10 devstack sudo[73101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:17:10 devstack sudo[73101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:10 devstack sudo[73101]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:10 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:10 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:10 devstack sudo[73107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:17:10 devstack sudo[73107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:11 devstack sudo[73107]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:11 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:11 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:11 devstack sudo[73112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:17:11 devstack sudo[73112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:11 devstack sudo[73112]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:11 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:11 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:11 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:11 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:11 devstack sudo[73116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:17:11 devstack sudo[73116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:12 devstack sudo[73116]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:12 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:12 devstack cinder-volume[72391]: INFO cinder.volume.drivers.lvm [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 13 17:17:12 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:12 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:12 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:12 devstack sudo[73141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:17:12 devstack sudo[73141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:12 devstack sudo[73141]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:12 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.462s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:12 devstack cinder-volume[72391]: DEBUG cinder.volume.drivers.lvm [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Updating volume stats {{(pid=72391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 17:17:12 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:12 devstack sudo[73241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:17:12 devstack sudo[73241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:13 devstack sudo[73241]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:13 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:13 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:13 devstack sudo[73292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:17:13 devstack sudo[73292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:13 devstack sudo[73292]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:13 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:13 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:13 devstack sudo[73383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:17:13 devstack sudo[73383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:14 devstack sudo[73383]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:14 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.441s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:14 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:14 devstack sudo[73386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:17:14 devstack sudo[73386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:14 devstack sudo[73386]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:14 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:14 devstack cinder-volume[72391]: INFO cinder.volume.driver [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Driver hasn't implemented _init_vendor_properties() Apr 13 17:17:14 devstack cinder-volume[72391]: DEBUG cinder.volume.driver [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72391) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 17:17:14 devstack cinder-volume[72391]: DEBUG oslo_db.sqlalchemy.engines [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72391) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:17:14 devstack cinder-volume[72391]: DEBUG dbcounter [-] [72391] Writer thread running {{(pid=72391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 17:17:14 devstack cinder-volume[72391]: DEBUG cinder.db.sqlalchemy.api [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Building query based on filter {{(pid=72391) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 17:17:14 devstack cinder-volume[72391]: DEBUG cinder.image.image_utils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72391) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 17:17:14 devstack cinder-volume[72391]: INFO cinder.keymgr.migration [None req-6ad3c090-2722-41d4-9918-4fdd6a228746 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 17:17:14 devstack cinder-volume[72391]: DEBUG cinder.volume.drivers.lvm [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Updating volume stats {{(pid=72391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 17:17:14 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:14 devstack sudo[73394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:17:14 devstack sudo[73394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:15 devstack sudo[73394]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:15 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:15 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:15 devstack sudo[73398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:17:15 devstack sudo[73398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:15 devstack sudo[73398]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:15 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:15 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:15 devstack sudo[73402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:17:15 devstack sudo[73402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:16 devstack sudo[73402]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:16 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:16 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:16 devstack sudo[73408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:17:16 devstack sudo[73408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:16 devstack cinder-volume[72286]: DEBUG dbcounter [-] [72286] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72286) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:17:16 devstack sudo[73408]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:16 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.508s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:16 devstack cinder-volume[72391]: DEBUG cinder.manager [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Notifying Schedulers of capabilities ... {{(pid=72391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:17:16 devstack cinder-volume[72391]: INFO cinder.volume.manager [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Driver initialization completed successfully. Apr 13 17:17:16 devstack cinder-volume[72391]: INFO cinder.manager [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Initiating service 2 cleanup Apr 13 17:17:16 devstack cinder-volume[72391]: INFO cinder.manager [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Service 2 cleanup completed. Apr 13 17:17:16 devstack cinder-volume[72391]: DEBUG cinder.service [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Creating RPC server for service cinder-volume {{(pid=72391) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 17:17:16 devstack cinder-volume[72391]: DEBUG cinder.service [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72391) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 17:17:16 devstack cinder-volume[72391]: INFO cinder.volume.manager [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 13 17:17:16 devstack cinder-volume[72391]: DEBUG cinder.volume.drivers.lvm [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Updating volume stats {{(pid=72391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 17:17:16 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:16 devstack sudo[73417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:17:16 devstack sudo[73417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:17 devstack sudo[73417]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:17 devstack sudo[73420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:17:17 devstack sudo[73420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:17 devstack sudo[73420]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:17 devstack sudo[73477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:17:17 devstack sudo[73477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:18 devstack sudo[73477]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:18 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:18 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:17:18 devstack sudo[73480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:17:18 devstack sudo[73480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:17:18 devstack sudo[73480]: pam_unix(sudo:session): session closed for user root Apr 13 17:17:18 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:17:18 devstack cinder-volume[72391]: INFO cinder.volume.manager [None req-5c76dfb9-a66f-446b-b761-05e2b6034627 None None] Driver post RPC initialization completed successfully. Apr 13 17:17:28 devstack cinder-volume[72391]: DEBUG dbcounter [-] [72391] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:17:28 devstack cinder-volume[72391]: DEBUG dbcounter [-] [72391] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:18:16 devstack cinder-volume[72391]: DEBUG oslo_service.periodic_task [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:18:16 devstack cinder-volume[72391]: DEBUG cinder.volume.drivers.lvm [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Updating volume stats {{(pid=72391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 17:18:16 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:18:16 devstack sudo[78216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:18:16 devstack sudo[78216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:18:17 devstack sudo[78216]: pam_unix(sudo:session): session closed for user root Apr 13 17:18:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:18:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:18:17 devstack sudo[78219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:18:17 devstack sudo[78219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:18:17 devstack sudo[78219]: pam_unix(sudo:session): session closed for user root Apr 13 17:18:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:18:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:18:17 devstack sudo[78222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:18:17 devstack sudo[78222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:18:17 devstack sudo[78222]: pam_unix(sudo:session): session closed for user root Apr 13 17:18:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:18:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:18:17 devstack sudo[78226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:18:17 devstack sudo[78226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:18:18 devstack sudo[78226]: pam_unix(sudo:session): session closed for user root Apr 13 17:18:18 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:18:18 devstack cinder-volume[72391]: DEBUG cinder.manager [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Notifying Schedulers of capabilities ... {{(pid=72391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:19:16 devstack cinder-volume[72391]: DEBUG oslo_service.periodic_task [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:19:16 devstack cinder-volume[72391]: DEBUG cinder.volume.drivers.lvm [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Updating volume stats {{(pid=72391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 17:19:16 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:19:16 devstack sudo[79339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:19:16 devstack sudo[79339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:19:17 devstack sudo[79339]: pam_unix(sudo:session): session closed for user root Apr 13 17:19:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:19:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:19:17 devstack sudo[79371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:19:17 devstack sudo[79371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:19:17 devstack sudo[79371]: pam_unix(sudo:session): session closed for user root Apr 13 17:19:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:19:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:19:17 devstack sudo[79381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:19:17 devstack sudo[79381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:19:17 devstack sudo[79381]: pam_unix(sudo:session): session closed for user root Apr 13 17:19:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:19:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:19:17 devstack sudo[79407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:19:17 devstack sudo[79407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:19:18 devstack sudo[79407]: pam_unix(sudo:session): session closed for user root Apr 13 17:19:18 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:19:18 devstack cinder-volume[72391]: DEBUG cinder.manager [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Notifying Schedulers of capabilities ... {{(pid=72391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:19:28 devstack cinder-volume[72391]: DEBUG dbcounter [-] [72391] Writing DB stats cinder:SELECT=1 {{(pid=72391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:19:28 devstack cinder-volume[72391]: DEBUG dbcounter [-] [72391] Writing DB stats cinder:UPDATE=1 {{(pid=72391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:20:16 devstack cinder-volume[72391]: DEBUG oslo_service.periodic_task [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:20:16 devstack cinder-volume[72391]: DEBUG cinder.volume.drivers.lvm [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Updating volume stats {{(pid=72391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 17:20:16 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:16 devstack sudo[80969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:20:16 devstack sudo[80969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:20:17 devstack sudo[80969]: pam_unix(sudo:session): session closed for user root Apr 13 17:20:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:17 devstack sudo[80975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:20:17 devstack sudo[80975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:20:17 devstack sudo[80975]: pam_unix(sudo:session): session closed for user root Apr 13 17:20:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:17 devstack sudo[80978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:20:17 devstack sudo[80978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:20:17 devstack sudo[80978]: pam_unix(sudo:session): session closed for user root Apr 13 17:20:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:17 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:17 devstack sudo[80982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:20:17 devstack sudo[80982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:20:18 devstack sudo[80982]: pam_unix(sudo:session): session closed for user root Apr 13 17:20:18 devstack cinder-volume[72391]: DEBUG oslo_concurrency.processutils [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:18 devstack cinder-volume[72391]: DEBUG cinder.manager [None req-46d0e7ad-7cd1-400a-9e46-cce0acaa188e None None] Notifying Schedulers of capabilities ... {{(pid=72391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:20:35 devstack cinder-volume[72286]: INFO oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Caught SIGTERM, stopping children Apr 13 17:20:35 devstack cinder-volume[72286]: DEBUG oslo_concurrency.lockutils [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Acquiring lock "singleton_lock" {{(pid=72286) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:20:35 devstack cinder-volume[72286]: DEBUG oslo_concurrency.lockutils [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Acquired lock "singleton_lock" {{(pid=72286) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:20:35 devstack cinder-volume[72286]: DEBUG oslo_concurrency.lockutils [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Releasing lock "singleton_lock" {{(pid=72286) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:20:35 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Stop services. {{(pid=72286) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 13 17:20:35 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Killing children. {{(pid=72286) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 13 17:20:35 devstack cinder-volume[72286]: INFO oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Waiting on 1 children to exit Apr 13 17:20:36 devstack cinder-volume[72391]: DEBUG oslo_concurrency.lockutils [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Acquiring lock "singleton_lock" {{(pid=72391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:20:36 devstack cinder-volume[72391]: DEBUG oslo_concurrency.lockutils [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Acquired lock "singleton_lock" {{(pid=72391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:20:36 devstack cinder-volume[72391]: DEBUG oslo_concurrency.lockutils [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Releasing lock "singleton_lock" {{(pid=72391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:20:36 devstack cinder-volume[72391]: WARNING amqp [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 17:20:36 devstack cinder-volume[72391]: WARNING amqp [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 17:20:36 devstack cinder-volume[72286]: INFO oslo_service.backend._eventlet.service [None req-3c4ff6a3-a044-4f03-a0a4-7a9fe79d8d89 None None] Child 72391 exited with status 0 Apr 13 17:20:36 devstack cinder-volume[81495]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 17:20:36 devstack cinder-volume[81495]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 17:20:36 devstack cinder-volume[81495]: we strongly recommend against using it for new projects. Apr 13 17:20:36 devstack cinder-volume[81495]: If you are already using Eventlet, we recommend migrating to a different Apr 13 17:20:36 devstack cinder-volume[81495]: framework. For more detail see Apr 13 17:20:36 devstack cinder-volume[81495]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 17:20:36 devstack cinder-volume[81495]: import eventlet # noqa Apr 13 17:20:38 devstack cinder-volume[81495]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81495) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:20:38 devstack cinder-volume[81495]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81495) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:20:38 devstack cinder-volume[81495]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81495) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:20:39 devstack cinder-volume[81495]: INFO dbcounter [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Registered counter for database cinder Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81495) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG dbcounter [-] [81495] Writer thread running {{(pid=81495) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 17:20:39 devstack cinder-volume[81495]: INFO cinder.rpc [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 17:20:39 devstack cinder-volume[81495]: INFO cinder.rpc [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81495) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:20:39 devstack cinder-volume[81495]: INFO cinder.volume.manager [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Determined volume DB was empty at startup. Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG cinder.volume.manager [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81495) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 17:20:39 devstack cinder-volume[81495]: INFO cinder.volume.manager [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 13 17:20:39 devstack cinder-volume[81495]: WARNING stevedore.named [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 17:20:39 devstack cinder-volume[81495]: WARNING castellan.key_manager [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:20:39 devstack cinder-volume[81495]: WARNING cinder.keymgr.conf_key_mgr [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:20:39 devstack cinder-volume[81495]: INFO cinder.volume.manager [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81495) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:20:39 devstack cinder-volume[81495]: INFO oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Starting 1 workers Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Started child 81613 {{(pid=81495) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Full set of CONF: {{(pid=81495) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] ******************************************************************************** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Configuration options gathered from: {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] ================================================================================ {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 17:20:39 devstack cinder-volume[81613]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] allow_availability_zone_fallback = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] allow_compression_on_image_upload = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] allowed_direct_url_schemes = [] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] api_rate_limit = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] auth_strategy = keystone {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_availability_zone = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_host = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_name = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_stats_polling_interval = 60 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backup_api_class = cinder.backup.api.API {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backup_name_template = backup-%s {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backup_use_same_host = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backup_use_temp_snapshot = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] chap_password = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] chap_username = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cinder_internal_tenant_project_id = 13f38e929ce646809e21d456e6382b95 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cinder_internal_tenant_user_id = 775754842e0740da83f49a52b00b07eb {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cluster = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] compression_format = gzip {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] compute_api_class = cinder.compute.nova.API {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] config_dir = [] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] config_source = [] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] control_exchange = openstack {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] debug = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] default_availability_zone = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] default_group_type = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] default_volume_type = QuobyteHD {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] disk_geometry = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] driver_client_cert = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] driver_client_cert_key = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] driver_data_namespace = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] driver_ssl_cert_path = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] driver_ssl_cert_verify = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] driver_use_ssl = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] enable_new_services = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] enable_unsupported_driver = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] enabled_backends = ['QuobyteHD'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] enforce_multipath_for_image_xfer = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] filter_function = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance_api_insecure = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance_api_servers = ['http://192.168.122.27/image'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance_api_ssl_compression = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance_ca_certificates_file = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance_catalog_info = image:glance:publicURL {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance_certfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance_keyfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance_num_retries = 3 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance_request_timeout = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] goodness_function = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] graceful_shutdown_timeout = 5 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] group_api_class = cinder.group.api.API {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] host = devstack {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] image_compress_on_upload = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] image_conversion_address_space_limit = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] image_conversion_cpu_limit = 60 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] image_conversion_disable = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] image_upload_use_cinder_backend = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] image_upload_use_internal_tenant = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81613]: INFO cinder.volume.manager [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Starting volume driver QuobyteDriver (1.1.14) Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] image_volume_cache_enabled = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81613]: DEBUG cinder.volume.drivers.remotefs [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81613) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] image_volume_cache_max_count = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] image_volume_cache_max_size_gb = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] init_host_max_objects_retrieval = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] instance_format = [instance: %(uuid)s] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] iscsi_target_flags = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] iscsi_write_cache = on {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] iser_helper = tgtadm {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] iser_ip_address = 192.168.122.27 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] iser_port = 3260 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] log_color = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] log_config_append = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] log_dir = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] log_file = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] log_options = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] log_rotate_interval = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] log_rotate_interval_type = days {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] log_rotation_type = none {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] max_age = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] max_logfile_count = 30 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] max_logfile_size_mb = 200 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] max_over_subscription_ratio = 20.0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] message_reap_interval = 86400 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] message_ttl = 2592000 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] migration_create_volume_timeout_secs = 300 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] monkey_patch = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] monkey_patch_modules = [] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] my_ip = 192.168.122.27 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] no_snapshot_gb_quota = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] num_iser_scan_tries = 3 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] num_shell_tries = 3 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] num_volume_device_scan_tries = 3 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] nvmeof_conn_info_version = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] nvmet_ns_id = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] nvmet_port_id = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] osapi_max_limit = 1000 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] osapi_volume_ext_list = [] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] osapi_volume_listen_port = 8776 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] osapi_volume_use_ssl = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] osapi_volume_workers = 2 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] per_volume_size_limit = -1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] periodic_fuzzy_delay = 60 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] periodic_interval = 60 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] public_endpoint = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] publish_errors = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] quota_backup_gigabytes = 1000 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] quota_backups = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] quota_gigabytes = 1000 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] quota_groups = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] quota_snapshots = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] quota_volumes = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] rate_limit_burst = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] rate_limit_except_level = CRITICAL {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] rate_limit_interval = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] reinit_driver_count = 3 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] replication_device = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] report_discard_supported = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] report_interval = 120 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] reservation_clean_interval = 86400 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] reservation_expire = 86400 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] reserved_image_namespaces = [] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] reserved_percentage = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] rpc_response_timeout = 120 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] run_external_periodic_tasks = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] scst_target_driver = iscsi {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] scst_target_iqn_name = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] service_down_time = 720 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] shell_completion = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] snapshot_name_template = snapshot-%s {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] split_loggers = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] state_path = /opt/stack/data/cinder {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] storage_availability_zone = nova {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] storage_protocol = iSCSI {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] syslog_log_facility = LOG_USER {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] target_helper = lioadm {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] target_ip_address = 192.168.122.27 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] target_port = 3260 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] target_protocol = iscsi {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] target_secondary_ip_addresses = [] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] trace_flags = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] transport_url = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] until_refresh = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] use_chap_auth = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] use_default_quota_class = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] use_journal = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] use_json = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] use_multipath_for_image_xfer = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] use_stderr = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] use_syslog = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] verify_glance_signatures = enabled {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volume_api_class = cinder.volume.api.API {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volume_backend_name = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volume_clear = zero {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volume_clear_ionice = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volume_clear_size = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volume_copy_bps_limit = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volume_dd_blocksize = 1M {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volume_name_template = volume-%s {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volume_service_inithost_offload = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volume_usage_audit_period = month {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] zoning_mode = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_concurrency.disable_process_locking = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.admin_password = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.admin_token = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.admin_user = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.auth_port = 35357 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.auth_protocol = https {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.auth_section = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.auth_type = password {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.auth_uri = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.auth_version = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.cache = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.certfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81613]: DEBUG cinder.volume.drivers.quobyte [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81613) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81613]: WARNING cinder.volume.drivers.quobyte [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81613]: WARNING cinder.volume.drivers.quobyte [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.identity_uri = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.include_service_catalog = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.insecure = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.interface = public {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.keyfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_password = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81613]: DEBUG oslo_concurrency.processutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Running cmd (subprocess): mount.quobyte {{(pid=81613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:39 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcache_username = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.region_name = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.service_type = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.27/identity {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.backend = dogpile.cache.null {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.backend_argument = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.backend_expiration_time = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.config_prefix = cache.oslo {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.debug_cache_backend = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.enable_retry_client = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.enable_socket_keepalive = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.enabled = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.enforce_fips_mode = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.expiration_time = 600 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.hashclient_retry_attempts = 2 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.memcache_dead_retry = 300 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.memcache_pool_maxsize = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.memcache_sasl_enabled = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.password = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.proxies = [] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.redis_db = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.redis_server = localhost:6379 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.retry_attempts = 2 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.retry_delay = 0.0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.socket_keepalive_count = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.socket_keepalive_idle = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.socket_keepalive_interval = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.socket_timeout = 1.0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.tls_allowed_ciphers = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.tls_cafile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.tls_certfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.tls_enabled = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.tls_keyfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cache.username = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] coordination.backend_url = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.asyncio_connection = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.asyncio_slave_connection = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.backend = sqlalchemy {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.connection = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.connection_debug = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.connection_parameters = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.connection_recycle_time = 3600 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.connection_trace = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.db_inc_retry_interval = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.db_max_retries = 20 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.db_max_retry_interval = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.db_retry_interval = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.max_overflow = 50 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.max_pool_size = 5 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.max_retries = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.mysql_wsrep_sync_wait = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.pool_timeout = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.retry_interval = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.slave_connection = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.sqlite_synchronous = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.synchronous_reader = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] database.use_db_reconnect = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler.connection_string = messaging:// {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler.enabled = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler.es_doc_type = notification {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler.es_scroll_size = 10000 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler.es_scroll_time = 2m {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler.filter_error_trace = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler.hmac_keys = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler.sentinel_service_name = mymaster {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler.socket_timeout = 0.1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler.trace_requests = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler.trace_sqlalchemy = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler_jaeger.process_tags = {} {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler_jaeger.service_name_prefix = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] profiler_otlp.service_name_prefix = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_policy.enforce_new_defaults = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: WARNING oslo_config.cfg [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_policy.enforce_scope = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_policy.policy_default_rule = default {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_policy.policy_file = policy.yaml {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] privsep_osbrick.group = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] privsep_osbrick.helper_command = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] privsep_osbrick.user = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cinder_sys_admin.group = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cinder_sys_admin.helper_command = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] cinder_sys_admin.user = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] service_user.auth_section = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] service_user.auth_type = password {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] service_user.cafile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] service_user.certfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] service_user.collect_timing = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] service_user.insecure = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] service_user.keyfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] service_user.send_service_user_token = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] service_user.split_loggers = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] service_user.timeout = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance.auth_section = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance.auth_type = password {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance.certfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance.collect_timing = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance.insecure = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance.keyfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance.region_name = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance.split_loggers = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] glance.timeout = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.backend_availability_zone = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.chap_password = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.chap_username = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.disk_geometry = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.driver_client_cert = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.driver_client_cert_key = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.driver_data_namespace = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.driver_use_ssl = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.extra_capabilities = {} {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.filter_function = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.goodness_function = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.iscsi_target_flags = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.iscsi_write_cache = on {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.iser_helper = tgtadm {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.iser_ip_address = 192.168.122.27 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.iser_port = 3260 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nas_host = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nas_login = admin {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nas_mount_options = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nas_password = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nas_private_key = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nas_share_path = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.num_shell_tries = 3 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.quobyte_volume_url = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.replication_device = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.report_discard_supported = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.reserved_percentage = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.target_helper = tgtadm {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.target_ip_address = 192.168.122.27 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.target_port = 3260 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.target_protocol = iscsi {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.trace_flags = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.unique_fqdn_network = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.use_chap_auth = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.volume_backend_name = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.volume_clear = zero {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.volume_clear_ionice = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.volume_clear_size = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_reports.file_event_handler = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_reports.log_dir = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.backend_availability_zone = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.backend_host = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.chap_password = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.chap_username = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.chiscsi_conf = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.disk_geometry = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.driver_client_cert = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.driver_data_namespace = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.driver_use_ssl = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.extra_capabilities = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.filter_function = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.goodness_function = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.iser_helper = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.iser_ip_address = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.iser_port = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.iser_target_prefix = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nas_host = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nas_login = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nas_mount_options = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nas_password = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nas_private_key = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nas_share_path = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nas_ssh_port = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.num_shell_tries = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.nvmet_port_id = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.replication_device = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.report_discard_supported = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.reserved_percentage = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.scst_target_driver = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.storage_protocol = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.target_helper = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.target_ip_address = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.target_port = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.target_prefix = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.target_protocol = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.trace_flags = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.use_chap_auth = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.volume_clear = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.volume_clear_size = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] QuobyteHD.volumes_dir = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack quobyte-client[81614]: Reading configuration file: /etc/quobyte/client.cfg Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack quobyte-client[81614]: Invalid parameters found, error: missing mount point. Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack quobyte-client[81614]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.ssl = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack quobyte-client[81614]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_notifications.driver = [] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_notifications.retry = -1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] key_manager.fixed_key = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.barbican_api_version = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.barbican_endpoint = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.barbican_endpoint_type = public {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.barbican_region_name = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.cafile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.certfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.collect_timing = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.insecure = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.keyfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.number_of_retries = 60 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.retry_delay = 1 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.send_service_user_token = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.split_loggers = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.timeout = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.verify_ssl = True {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican.verify_ssl_path = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican_service_user.auth_section = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican_service_user.auth_type = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican_service_user.cafile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican_service_user.certfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican_service_user.collect_timing = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican_service_user.insecure = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican_service_user.keyfile = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican_service_user.split_loggers = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] barbican_service_user.timeout = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] vault.approle_role_id = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] vault.approle_secret_id = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] vault.kv_mountpoint = secret {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] vault.kv_path = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] vault.kv_version = 2 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] vault.namespace = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] vault.root_token_id = **** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] vault.ssl_ca_crt_file = None {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] vault.timeout = 60.0 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] vault.use_ssl = False {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:40 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] ******************************************************************************** {{(pid=81495) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 17:20:40 devstack cinder-volume[81613]: DEBUG oslo_concurrency.processutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] CMD "mount.quobyte" returned: 1 in 0.098s {{(pid=81613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:40 devstack cinder-volume[81613]: DEBUG oslo_concurrency.lockutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:20:40 devstack cinder-volume[81613]: DEBUG oslo_concurrency.lockutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:20:40 devstack cinder-volume[81613]: DEBUG cinder.volume.drivers.quobyte [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:20:40 devstack cinder-volume[81613]: INFO cinder.volume.drivers.quobyte [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 ... Apr 13 17:20:40 devstack cinder-volume[81613]: DEBUG oslo_concurrency.processutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 -c /etc/quobyte/client-cinder.cfg {{(pid=81613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:40 devstack sudo[81615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 -c /etc/quobyte/client-cinder.cfg Apr 13 17:20:40 devstack sudo[81615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:20:40 devstack sudo[81615]: pam_unix(sudo:session): session closed for user root Apr 13 17:20:40 devstack cinder-volume[81613]: DEBUG oslo_concurrency.processutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.505s {{(pid=81613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:40 devstack cinder-volume[81613]: INFO cinder.volume.drivers.quobyte [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 succeeded Apr 13 17:20:40 devstack cinder-volume[81613]: DEBUG cinder.volume.drivers.quobyte [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:20:40 devstack cinder-volume[81613]: DEBUG oslo_concurrency.lockutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.512s {{(pid=81613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:20:40 devstack cinder-volume[81613]: DEBUG oslo_concurrency.processutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:40 devstack sudo[81684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:20:40 devstack sudo[81684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:20:40 devstack sudo[81684]: pam_unix(sudo:session): session closed for user root Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG oslo_concurrency.processutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.393s {{(pid=81613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:41 devstack cinder-volume[81613]: INFO cinder.volume.driver [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Driver hasn't implemented _init_vendor_properties() Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG cinder.volume.driver [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81613) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG oslo_db.sqlalchemy.engines [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81613) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG dbcounter [-] [81613] Writer thread running {{(pid=81613) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG cinder.db.sqlalchemy.api [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Building query based on filter {{(pid=81613) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG cinder.image.image_utils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81613) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 17:20:41 devstack cinder-volume[81613]: INFO cinder.keymgr.migration [None req-f4c7707a-8678-444d-bd3e-775646f27cd5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG oslo_concurrency.lockutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG oslo_concurrency.lockutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG cinder.volume.drivers.quobyte [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG cinder.volume.drivers.quobyte [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG oslo_concurrency.lockutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG oslo_concurrency.processutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:41 devstack sudo[81687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:20:41 devstack sudo[81687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:20:41 devstack sudo[81687]: pam_unix(sudo:session): session closed for user root Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG oslo_concurrency.processutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.378s {{(pid=81613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG cinder.manager [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Notifying Schedulers of capabilities ... {{(pid=81613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:20:41 devstack cinder-volume[81613]: INFO cinder.volume.manager [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Driver initialization completed successfully. Apr 13 17:20:41 devstack cinder-volume[81613]: INFO cinder.manager [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Initiating service 3 cleanup Apr 13 17:20:41 devstack cinder-volume[81613]: INFO cinder.manager [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Service 3 cleanup completed. Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG cinder.service [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Creating RPC server for service cinder-volume {{(pid=81613) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG cinder.service [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81613) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 17:20:41 devstack cinder-volume[81613]: INFO cinder.volume.manager [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG oslo_concurrency.lockutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG oslo_concurrency.lockutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG cinder.volume.drivers.quobyte [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81613) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG cinder.volume.drivers.quobyte [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81613) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG oslo_concurrency.lockutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG oslo_concurrency.processutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:41 devstack sudo[81692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:20:41 devstack sudo[81692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:20:41 devstack sudo[81692]: pam_unix(sudo:session): session closed for user root Apr 13 17:20:41 devstack cinder-volume[81613]: DEBUG oslo_concurrency.processutils [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.447s {{(pid=81613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:41 devstack cinder-volume[81613]: INFO cinder.volume.manager [None req-35e4e2f9-a4f7-41c8-8da8-67b65547dbef None None] Driver post RPC initialization completed successfully. Apr 13 17:20:44 devstack cinder-volume[81495]: INFO oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Caught SIGTERM, stopping children Apr 13 17:20:44 devstack cinder-volume[81495]: DEBUG oslo_concurrency.lockutils [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Acquiring lock "singleton_lock" {{(pid=81495) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:20:44 devstack cinder-volume[81495]: DEBUG oslo_concurrency.lockutils [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Acquired lock "singleton_lock" {{(pid=81495) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:20:44 devstack cinder-volume[81495]: DEBUG oslo_concurrency.lockutils [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Releasing lock "singleton_lock" {{(pid=81495) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:20:44 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Stop services. {{(pid=81495) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 13 17:20:44 devstack cinder-volume[81495]: DEBUG oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Killing children. {{(pid=81495) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 13 17:20:44 devstack cinder-volume[81495]: INFO oslo_service.backend._eventlet.service [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Waiting on 1 children to exit Apr 13 17:20:49 devstack cinder-volume[81613]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 13 17:20:49 devstack cinder-volume[81855]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 17:20:49 devstack cinder-volume[81855]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 17:20:49 devstack cinder-volume[81855]: we strongly recommend against using it for new projects. Apr 13 17:20:49 devstack cinder-volume[81855]: If you are already using Eventlet, we recommend migrating to a different Apr 13 17:20:49 devstack cinder-volume[81855]: framework. For more detail see Apr 13 17:20:49 devstack cinder-volume[81855]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 17:20:49 devstack cinder-volume[81855]: import eventlet # noqa Apr 13 17:20:49 devstack cinder-volume[81613]: DEBUG oslo_concurrency.lockutils [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Acquiring lock "singleton_lock" {{(pid=81613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:20:49 devstack cinder-volume[81613]: DEBUG oslo_concurrency.lockutils [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Acquired lock "singleton_lock" {{(pid=81613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:20:49 devstack cinder-volume[81613]: DEBUG oslo_concurrency.lockutils [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Releasing lock "singleton_lock" {{(pid=81613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:20:49 devstack cinder-volume[81613]: WARNING amqp [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 17:20:49 devstack cinder-volume[81613]: WARNING amqp [None req-7ae44a93-8889-46de-b61f-ba483a063c76 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81855) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81855) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81855) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:20:51 devstack cinder-volume[81855]: INFO dbcounter [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Registered counter for database cinder Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_db.sqlalchemy.engines [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81855) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG dbcounter [-] [81855] Writer thread running {{(pid=81855) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 17:20:51 devstack cinder-volume[81855]: INFO cinder.rpc [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 17:20:51 devstack cinder-volume[81855]: INFO cinder.rpc [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_db.sqlalchemy.engines [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81855) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:20:51 devstack cinder-volume[81855]: INFO cinder.volume.manager [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Determined volume DB was empty at startup. Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG cinder.volume.manager [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81855) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 17:20:51 devstack cinder-volume[81855]: WARNING stevedore.named [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 17:20:51 devstack cinder-volume[81855]: WARNING castellan.key_manager [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:20:51 devstack cinder-volume[81855]: WARNING cinder.keymgr.conf_key_mgr [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:20:51 devstack cinder-volume[81855]: INFO cinder.volume.manager [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_db.sqlalchemy.engines [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81855) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:20:51 devstack cinder-volume[81855]: INFO oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Starting 1 workers Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Started child 81998 {{(pid=81855) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Full set of CONF: {{(pid=81855) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] ******************************************************************************** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Configuration options gathered from: {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] ================================================================================ {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] allow_availability_zone_fallback = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] allow_compression_on_image_upload = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81998]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] allowed_direct_url_schemes = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] api_rate_limit = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] auth_strategy = keystone {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_availability_zone = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_host = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_stats_polling_interval = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backup_api_class = cinder.backup.api.API {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backup_name_template = backup-%s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backup_use_same_host = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backup_use_temp_snapshot = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] chap_password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] chap_username = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cinder_internal_tenant_project_id = 13f38e929ce646809e21d456e6382b95 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cinder_internal_tenant_user_id = 775754842e0740da83f49a52b00b07eb {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cluster = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] compression_format = gzip {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] compute_api_class = cinder.compute.nova.API {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] config_dir = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] config_source = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] control_exchange = openstack {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] debug = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] default_availability_zone = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] default_group_type = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] default_volume_type = QuobyteHD {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] disk_geometry = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] driver_client_cert = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] driver_client_cert_key = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] driver_data_namespace = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] driver_ssl_cert_path = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] driver_ssl_cert_verify = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] driver_use_ssl = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] enable_new_services = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] enable_unsupported_driver = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] enabled_backends = ['QuobyteHD'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] enforce_multipath_for_image_xfer = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] filter_function = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance_api_insecure = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance_api_servers = ['http://192.168.122.27/image'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance_api_ssl_compression = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance_ca_certificates_file = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance_catalog_info = image:glance:publicURL {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance_certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance_keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance_num_retries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance_request_timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] goodness_function = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] graceful_shutdown_timeout = 5 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] group_api_class = cinder.group.api.API {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] host = devstack {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] image_compress_on_upload = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] image_conversion_address_space_limit = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] image_conversion_cpu_limit = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] image_conversion_disable = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] image_upload_use_cinder_backend = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] image_upload_use_internal_tenant = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] image_volume_cache_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] image_volume_cache_max_count = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] image_volume_cache_max_size_gb = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] init_host_max_objects_retrieval = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] instance_format = [instance: %(uuid)s] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] iscsi_target_flags = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] iscsi_write_cache = on {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] iser_helper = tgtadm {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] iser_ip_address = 192.168.122.27 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] iser_port = 3260 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] log_color = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] log_config_append = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] log_dir = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] log_file = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] log_options = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] log_rotate_interval = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] log_rotate_interval_type = days {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] log_rotation_type = none {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] max_age = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] max_logfile_count = 30 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] max_logfile_size_mb = 200 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] max_over_subscription_ratio = 20.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] message_reap_interval = 86400 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] message_ttl = 2592000 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] migration_create_volume_timeout_secs = 300 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] monkey_patch = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] monkey_patch_modules = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] my_ip = 192.168.122.27 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81998) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] no_snapshot_gb_quota = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] num_iser_scan_tries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] num_shell_tries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] num_volume_device_scan_tries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] nvmeof_conn_info_version = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] nvmet_ns_id = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] nvmet_port_id = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] osapi_max_limit = 1000 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] osapi_volume_ext_list = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] osapi_volume_listen_port = 8776 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] osapi_volume_use_ssl = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] osapi_volume_workers = 2 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] per_volume_size_limit = -1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] periodic_fuzzy_delay = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] periodic_interval = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] public_endpoint = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] publish_errors = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] quota_backup_gigabytes = 1000 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] quota_backups = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] quota_gigabytes = 1000 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] quota_groups = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] quota_snapshots = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] quota_volumes = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] rate_limit_burst = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] rate_limit_except_level = CRITICAL {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] rate_limit_interval = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] reinit_driver_count = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] replication_device = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] report_discard_supported = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] report_interval = 120 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] reservation_clean_interval = 86400 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] reservation_expire = 86400 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] reserved_image_namespaces = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] reserved_percentage = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] rpc_response_timeout = 120 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] run_external_periodic_tasks = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] scst_target_driver = iscsi {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] scst_target_iqn_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] service_down_time = 720 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] shell_completion = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] snapshot_name_template = snapshot-%s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] split_loggers = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] state_path = /opt/stack/data/cinder {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] storage_availability_zone = nova {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] storage_protocol = iSCSI {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] syslog_log_facility = LOG_USER {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] target_helper = lioadm {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] target_ip_address = 192.168.122.27 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] target_port = 3260 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] target_protocol = iscsi {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] target_secondary_ip_addresses = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] trace_flags = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] transport_url = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] until_refresh = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] use_chap_auth = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] use_default_quota_class = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] use_journal = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] use_json = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] use_multipath_for_image_xfer = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] use_stderr = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] use_syslog = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] verify_glance_signatures = enabled {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volume_api_class = cinder.volume.api.API {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volume_backend_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volume_clear = zero {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volume_clear_ionice = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volume_clear_size = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volume_copy_bps_limit = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volume_dd_blocksize = 1M {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volume_name_template = volume-%s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volume_service_inithost_offload = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volume_usage_audit_period = month {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] zoning_mode = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_concurrency.disable_process_locking = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.admin_password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.admin_token = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.admin_user = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.auth_port = 35357 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.auth_protocol = https {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.auth_section = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.auth_type = password {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.auth_uri = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.auth_version = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.cache = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.identity_uri = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.include_service_catalog = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.insecure = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.interface = public {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_password = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcache_username = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.region_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.service_type = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.27/identity {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.backend = dogpile.cache.null {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.backend_argument = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.backend_expiration_time = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.config_prefix = cache.oslo {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.debug_cache_backend = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.enable_retry_client = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.enable_socket_keepalive = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.enforce_fips_mode = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:51 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.expiration_time = 600 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.hashclient_retry_attempts = 2 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.memcache_dead_retry = 300 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.memcache_pool_maxsize = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.memcache_sasl_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.proxies = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.redis_db = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.redis_server = localhost:6379 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.retry_attempts = 2 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.retry_delay = 0.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.socket_keepalive_count = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.socket_keepalive_idle = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.socket_keepalive_interval = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.socket_timeout = 1.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.tls_allowed_ciphers = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.tls_cafile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.tls_certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.tls_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.tls_keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cache.username = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] coordination.backend_url = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.asyncio_connection = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.asyncio_slave_connection = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.backend = sqlalchemy {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.connection = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.connection_debug = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.connection_parameters = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.connection_recycle_time = 3600 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.connection_trace = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.db_inc_retry_interval = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.db_max_retries = 20 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81998) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.db_max_retry_interval = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.quobyte [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.db_retry_interval = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.max_overflow = 50 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.max_pool_size = 5 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.quobyte [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.max_retries = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.mysql_wsrep_sync_wait = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.pool_timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.retry_interval = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.slave_connection = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.sqlite_synchronous = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.synchronous_reader = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Running cmd (subprocess): mount.quobyte {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] database.use_db_reconnect = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler.connection_string = messaging:// {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler.enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler.es_doc_type = notification {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler.es_scroll_size = 10000 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler.es_scroll_time = 2m {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler.filter_error_trace = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler.hmac_keys = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler.sentinel_service_name = mymaster {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler.socket_timeout = 0.1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler.trace_requests = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler.trace_sqlalchemy = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler_jaeger.process_tags = {} {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler_jaeger.service_name_prefix = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] profiler_otlp.service_name_prefix = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_policy.enforce_new_defaults = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: WARNING oslo_config.cfg [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_policy.enforce_scope = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_policy.policy_default_rule = default {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_policy.policy_file = policy.yaml {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] privsep_osbrick.group = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] privsep_osbrick.helper_command = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] privsep_osbrick.user = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cinder_sys_admin.group = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cinder_sys_admin.helper_command = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] cinder_sys_admin.user = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] service_user.auth_section = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] service_user.auth_type = password {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] service_user.cafile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] service_user.certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] service_user.collect_timing = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] service_user.insecure = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] service_user.keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] service_user.send_service_user_token = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] service_user.split_loggers = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] service_user.timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance.auth_section = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance.auth_type = password {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance.certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance.collect_timing = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance.insecure = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance.keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance.region_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance.split_loggers = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] glance.timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.backend_availability_zone = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.chap_password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.chap_username = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.disk_geometry = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.driver_client_cert = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.driver_client_cert_key = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.driver_data_namespace = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.driver_use_ssl = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.extra_capabilities = {} {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.filter_function = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.goodness_function = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.iscsi_target_flags = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.iscsi_write_cache = on {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.iser_helper = tgtadm {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.iser_ip_address = 192.168.122.27 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.iser_port = 3260 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nas_host = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nas_login = admin {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nas_mount_options = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nas_password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nas_private_key = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nas_share_path = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.num_shell_tries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.quobyte_volume_url = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.replication_device = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.report_discard_supported = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.reserved_percentage = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.target_helper = tgtadm {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.target_ip_address = 192.168.122.27 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.target_port = 3260 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.target_protocol = iscsi {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.trace_flags = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.unique_fqdn_network = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.use_chap_auth = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.volume_backend_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.volume_clear = zero {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.volume_clear_ionice = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.volume_clear_size = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_reports.file_event_handler = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_reports.log_dir = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.backend_availability_zone = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.backend_host = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.chap_password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.chap_username = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.chiscsi_conf = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.disk_geometry = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.driver_client_cert = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.driver_data_namespace = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.driver_use_ssl = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.extra_capabilities = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.filter_function = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.goodness_function = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.iser_helper = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.iser_ip_address = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.iser_port = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.iser_target_prefix = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nas_host = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nas_login = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nas_mount_options = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nas_password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nas_private_key = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nas_share_path = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nas_ssh_port = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.num_shell_tries = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.nvmet_port_id = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.replication_device = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.report_discard_supported = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.reserved_percentage = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.scst_target_driver = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.storage_protocol = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.target_helper = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.target_ip_address = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.target_port = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.target_prefix = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.target_protocol = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.trace_flags = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.use_chap_auth = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.volume_clear = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.volume_clear_size = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] QuobyteHD.volumes_dir = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack quobyte-client[82017]: Reading configuration file: /etc/quobyte/client.cfg Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack quobyte-client[82017]: Invalid parameters found, error: missing mount point. Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack quobyte-client[82017]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack quobyte-client[82017]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.ssl = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_notifications.driver = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_notifications.retry = -1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] key_manager.fixed_key = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.barbican_api_version = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.barbican_endpoint = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.barbican_endpoint_type = public {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.barbican_region_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.cafile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.collect_timing = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.insecure = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.number_of_retries = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.retry_delay = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.send_service_user_token = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.split_loggers = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.verify_ssl = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican.verify_ssl_path = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican_service_user.auth_section = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican_service_user.auth_type = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican_service_user.cafile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican_service_user.certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican_service_user.collect_timing = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican_service_user.insecure = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican_service_user.keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican_service_user.split_loggers = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] barbican_service_user.timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] vault.approle_role_id = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] vault.approle_secret_id = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] CMD "mount.quobyte" returned: 1 in 0.089s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] vault.kv_mountpoint = secret {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] vault.kv_path = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] vault.kv_version = 2 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] vault.namespace = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] vault.root_token_id = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] vault.ssl_ca_crt_file = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] vault.timeout = 60.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] vault.use_ssl = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:20:52 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-132657ad-baeb-466a-a1b1-62cdb3e9d591 None None] ******************************************************************************** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:52 devstack sudo[82032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:20:52 devstack sudo[82032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:20:52 devstack sudo[82032]: pam_unix(sudo:session): session closed for user root Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.437s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:52 devstack cinder-volume[81998]: INFO cinder.volume.driver [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Driver hasn't implemented _init_vendor_properties() Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG cinder.volume.driver [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81998) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG oslo_db.sqlalchemy.engines [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81998) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writer thread running {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG cinder.db.sqlalchemy.api [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Building query based on filter {{(pid=81998) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81998) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:20:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:52 devstack cinder-volume[81998]: INFO cinder.keymgr.migration [None req-8260fe85-1040-4716-be09-e5f14649e67e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 17:20:52 devstack sudo[82068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:20:52 devstack sudo[82068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:20:53 devstack sudo[82068]: pam_unix(sudo:session): session closed for user root Apr 13 17:20:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.429s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:53 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:20:53 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Driver initialization completed successfully. Apr 13 17:20:53 devstack cinder-volume[81998]: INFO cinder.manager [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Initiating service 3 cleanup Apr 13 17:20:53 devstack cinder-volume[81998]: INFO cinder.manager [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Service 3 cleanup completed. Apr 13 17:20:53 devstack cinder-volume[81998]: DEBUG cinder.service [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Creating RPC server for service cinder-volume {{(pid=81998) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 17:20:53 devstack cinder-volume[81998]: DEBUG cinder.service [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81998) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 17:20:53 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 13 17:20:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:20:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:20:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:20:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:20:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:20:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:20:53 devstack sudo[82084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:20:53 devstack sudo[82084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:20:53 devstack sudo[82084]: pam_unix(sudo:session): session closed for user root Apr 13 17:20:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.432s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:20:53 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-615c6291-e442-4a0b-bc86-be1c74ac1c01 None None] Driver post RPC initialization completed successfully. Apr 13 17:21:01 devstack cinder-volume[81855]: DEBUG dbcounter [-] [81855] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81855) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:21:03 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:21:03 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=2 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Flow 'volume_create_manager' (96b4f2e0-b501-4cdd-8d81-021f1cb9cc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07f18cf-9db7-486f-9f56-e5b21ddf6f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Flow 'volume_create_manager' (4d74d93f-670a-46e4-83da-8fa2c68e74d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c2f524-38b1-4e4c-9e6c-c46dda486702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07f18cf-9db7-486f-9f56-e5b21ddf6f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-566203202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee76cf46092c47ba8ce341ef3b93f05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:21:48Z,use_quota=True,user_id='4d6b431a17634c44a93385721b8a58fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be8d75d-4305-4d02-94f8-4b7f086934e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be8d75d-4305-4d02-94f8-4b7f086934e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187c3e7f-af91-42e3-8b73-9611b51106b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187c3e7f-af91-42e3-8b73-9611b51106b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e', 'volume_name': 'volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bd4417-1699-418b-a80d-051e427eaace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bd4417-1699-418b-a80d-051e427eaace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0eb3940-7936-442b-9c9e-de8420bc44ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:48 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Volume 92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e', 'volume_size': 1} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-566203202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee76cf46092c47ba8ce341ef3b93f05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:21:48Z,use_quota=True,user_id='4d6b431a17634c44a93385721b8a58fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Creating volume 92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:21:48 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c2f524-38b1-4e4c-9e6c-c46dda486702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1922529815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f98e67a-277a-416f-a9be-7e6065e21c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41228613768d41e4a5e71f4ef9922480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:21:48Z,use_quota=True,user_id='d03816129d1547068f1bf690466c8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf04bc9d-9b3d-470b-9561-8c43db857ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf04bc9d-9b3d-470b-9561-8c43db857ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8b9b7d-bc6d-42f4-9b50-53bde091460a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:48 devstack sudo[82348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e 1073741824 Apr 13 17:21:48 devstack sudo[82348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8b9b7d-bc6d-42f4-9b50-53bde091460a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f98e67a-277a-416f-a9be-7e6065e21c0b', 'volume_name': 'volume-0f98e67a-277a-416f-a9be-7e6065e21c0b', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb46cf56-ec7f-440c-b16b-d17c11107e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb46cf56-ec7f-440c-b16b-d17c11107e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33ababe-7199-4257-9a46-704c9e0172d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:48 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Volume 0f98e67a-277a-416f-a9be-7e6065e21c0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f98e67a-277a-416f-a9be-7e6065e21c0b', 'volume_size': 1} Apr 13 17:21:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:21:49 devstack sudo[82348]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e 1073741824" returned: 0 in 0.577s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:49 devstack sudo[82674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e Apr 13 17:21:49 devstack sudo[82674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:49 devstack sudo[82674]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e" returned: 0 in 0.534s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.108s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1922529815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f98e67a-277a-416f-a9be-7e6065e21c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41228613768d41e4a5e71f4ef9922480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:21:48Z,use_quota=True,user_id='d03816129d1547068f1bf690466c8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Creating volume 0f98e67a-277a-416f-a9be-7e6065e21c0b {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:21:49 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0eb3940-7936-442b-9c9e-de8420bc44ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:49 devstack sudo[82678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b 1073741824 Apr 13 17:21:49 devstack sudo[82678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4a5361-0e5f-41b5-a4e4-c1d1a0d62004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:49 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Volume volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e (92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e): created successfully Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4a5361-0e5f-41b5-a4e4-c1d1a0d62004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Flow 'volume_create_manager' (96b4f2e0-b501-4cdd-8d81-021f1cb9cc0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:21:49 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-7f776fa7-db11-48b6-8308-c2d5b66a2134 tempest-VolumesTestJSON-1429156954 None] Created volume successfully. Apr 13 17:21:50 devstack sudo[82678]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b 1073741824" returned: 0 in 0.807s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Flow 'volume_create_manager' (5e152a9d-cd9f-490d-89d2-101481d27f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91096c16-0f3c-4911-bbd5-80af8e108580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91096c16-0f3c-4911-bbd5-80af8e108580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2052388243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de7855a-e397-42e7-8cb0-dd109745c3f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee76cf46092c47ba8ce341ef3b93f05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:21:50Z,use_quota=True,user_id='4d6b431a17634c44a93385721b8a58fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b00c97-b6b0-45d5-a8fb-24a4856bf5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b00c97-b6b0-45d5-a8fb-24a4856bf5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7f36f5-4157-41ff-936d-da55b1e849ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7f36f5-4157-41ff-936d-da55b1e849ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de7855a-e397-42e7-8cb0-dd109745c3f0', 'volume_name': 'volume-4de7855a-e397-42e7-8cb0-dd109745c3f0', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fda506d-0d9f-40e7-a67a-2416364ad205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fda506d-0d9f-40e7-a67a-2416364ad205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82d4753-303f-4e19-b628-b26692eadb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:50 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Volume 4de7855a-e397-42e7-8cb0-dd109745c3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de7855a-e397-42e7-8cb0-dd109745c3f0', 'volume_size': 1} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:21:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:50 devstack sudo[82688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b Apr 13 17:21:50 devstack sudo[82688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:51 devstack sudo[82688]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b" returned: 0 in 0.559s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.570s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2052388243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de7855a-e397-42e7-8cb0-dd109745c3f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee76cf46092c47ba8ce341ef3b93f05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:21:50Z,use_quota=True,user_id='4d6b431a17634c44a93385721b8a58fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Creating volume 4de7855a-e397-42e7-8cb0-dd109745c3f0 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:21:51 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4de7855a-e397-42e7-8cb0-dd109745c3f0 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:51 devstack sudo[82692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4de7855a-e397-42e7-8cb0-dd109745c3f0 1073741824 Apr 13 17:21:51 devstack sudo[82692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33ababe-7199-4257-9a46-704c9e0172d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f98e67a-277a-416f-a9be-7e6065e21c0b', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787af316-e4ef-4a40-9b67-11fbecf2bcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:51 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Volume volume-0f98e67a-277a-416f-a9be-7e6065e21c0b (0f98e67a-277a-416f-a9be-7e6065e21c0b): created successfully Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787af316-e4ef-4a40-9b67-11fbecf2bcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Flow 'volume_create_manager' (4d74d93f-670a-46e4-83da-8fa2c68e74d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:21:51 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-1c795d6e-b048-431b-89d2-68d3021f92d5 req-7026786e-ee3d-4f07-819a-76d23c63404e tempest-VolumesSnapshotsTestJSON-12325253 None] Created volume successfully. Apr 13 17:21:51 devstack sudo[82692]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4de7855a-e397-42e7-8cb0-dd109745c3f0 1073741824" returned: 0 in 0.567s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4de7855a-e397-42e7-8cb0-dd109745c3f0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:51 devstack sudo[82698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4de7855a-e397-42e7-8cb0-dd109745c3f0 Apr 13 17:21:51 devstack sudo[82698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:21:52 devstack sudo[82698]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4de7855a-e397-42e7-8cb0-dd109745c3f0" returned: 0 in 0.500s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.309s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82d4753-303f-4e19-b628-b26692eadb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de7855a-e397-42e7-8cb0-dd109745c3f0', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3ca467-8835-44ba-aebb-41298989ea9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:52 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Volume volume-4de7855a-e397-42e7-8cb0-dd109745c3f0 (4de7855a-e397-42e7-8cb0-dd109745c3f0): created successfully Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3ca467-8835-44ba-aebb-41298989ea9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Flow 'volume_create_manager' (5e152a9d-cd9f-490d-89d2-101481d27f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:21:52 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-fecdde93-41e4-4e8d-941a-6109b6eef3b9 tempest-VolumesTestJSON-1429156954 None] Created volume successfully. Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Creating offline snapshot c23afc46-6800-417c-88b8-bf1357095d21 of volume 0f98e67a-277a-416f-a9be-7e6065e21c0b {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:21:52 devstack cinder-volume[81998]: INFO oslo.privsep.daemon [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8flwpxld/privsep.sock'] Apr 13 17:21:52 devstack sudo[82701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8flwpxld/privsep.sock Apr 13 17:21:52 devstack sudo[82701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:52 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 13 17:21:52 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 17:21:52 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 13 17:21:52 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 17:21:52 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 13 17:21:52 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 13 17:21:52 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 17:21:52 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 17:21:52 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Flow 'volume_create_manager' (244099a8-75ff-4854-98b5-bcae82619ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2f6f9c-de1a-4ff8-a55e-0fdf5e26c500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2f6f9c-de1a-4ff8-a55e-0fdf5e26c500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-642968668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738b1a42-a44b-450e-8a7d-2e7df2fd542a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee76cf46092c47ba8ce341ef3b93f05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:21:53Z,use_quota=True,user_id='4d6b431a17634c44a93385721b8a58fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a66d3f6-2f1a-4133-a57c-d980b66db8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a66d3f6-2f1a-4133-a57c-d980b66db8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65aa52bf-36a1-47ae-9243-a004e77250b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65aa52bf-36a1-47ae-9243-a004e77250b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738b1a42-a44b-450e-8a7d-2e7df2fd542a', 'volume_name': 'volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e56b28-e4c4-4d01-a377-18a2ed2cda28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e56b28-e4c4-4d01-a377-18a2ed2cda28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60128178-43e8-4668-b760-e16dcaf907c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:52 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Volume 738b1a42-a44b-450e-8a7d-2e7df2fd542a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a', 'volume_size': 1} Apr 13 17:21:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:21:53 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 13 17:21:53 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 17:21:53 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 13 17:21:53 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 17:21:53 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 13 17:21:53 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 13 17:21:53 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 17:21:53 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 17:21:53 devstack cinder-volume[81998]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 13 17:21:53 devstack sudo[82701]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:53 devstack cinder-volume[81998]: INFO oslo.privsep.daemon [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Spawned new privsep daemon via rootwrap Apr 13 17:21:53 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Accepted privsep connection to /tmp/tmp8flwpxld/privsep.sock {{(pid=81998) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 13 17:21:53 devstack cinder-volume[81998]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 13 17:21:53 devstack cinder-volume[81998]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 13 17:21:53 devstack cinder-volume[81998]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 13 17:21:53 devstack cinder-volume[81998]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82711 Apr 13 17:21:53 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb1e8e2-4da7-4514-863d-674babaf9ac4]: (2,) {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:21:53 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a128055-d38a-4d93-b280-7021aa062977]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:21:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:53 devstack sudo[82714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b Apr 13 17:21:53 devstack sudo[82714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:54 devstack sudo[82714]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b" returned: 0 in 0.630s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:54 devstack sudo[82721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 1G Apr 13 17:21:54 devstack sudo[82721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:54 devstack sudo[82721]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 1G" returned: 0 in 0.581s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f98e67a-277a-416f-a9be-7e6065e21c0b -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:54 devstack sudo[82726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f98e67a-277a-416f-a9be-7e6065e21c0b -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 Apr 13 17:21:54 devstack sudo[82726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:55 devstack sudo[82726]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f98e67a-277a-416f-a9be-7e6065e21c0b -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21" returned: 0 in 0.738s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:55 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 is being set with open permissions: ugo+rw Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:55 devstack sudo[82732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 Apr 13 17:21:55 devstack sudo[82732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Flow 'volume_create_manager' (08c7e0b3-519f-460c-b67d-09749674b8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7322155-7eed-407f-993e-a5a6db3aa3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7322155-7eed-407f-993e-a5a6db3aa3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2114007341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3ce64b-cb08-4921-b62a-aa2f596195f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a781f79ae36d454186fe5005d275c632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:21:56Z,use_quota=True,user_id='e0d76adc5a4c4bd8a33e8f13f1a89a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f58aaa-c3ee-438e-a95f-3ddc4ba3fb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f58aaa-c3ee-438e-a95f-3ddc4ba3fb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4f447b-48c1-4082-b6f2-f112b9bce6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4f447b-48c1-4082-b6f2-f112b9bce6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3ce64b-cb08-4921-b62a-aa2f596195f1', 'volume_name': 'volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a5d40d-82e1-4222-a322-a99e744d6a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a5d40d-82e1-4222-a322-a99e744d6a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0363b9e-9a2e-4853-92df-3082024cdca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:55 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Volume 0d3ce64b-cb08-4921-b62a-aa2f596195f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1', 'volume_size': 1} Apr 13 17:21:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:21:56 devstack sudo[82732]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21" returned: 0 in 0.520s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:56 devstack sudo[82735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.info Apr 13 17:21:56 devstack sudo[82735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:56 devstack sudo[82735]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.info" returned: 0 in 0.460s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:56 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.info is being set with open permissions: ugo+rw Apr 13 17:21:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:56 devstack sudo[82752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.info Apr 13 17:21:56 devstack sudo[82752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:57 devstack sudo[82752]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.info" returned: 0 in 0.441s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.968s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.240s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-642968668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738b1a42-a44b-450e-8a7d-2e7df2fd542a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee76cf46092c47ba8ce341ef3b93f05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:21:53Z,use_quota=True,user_id='4d6b431a17634c44a93385721b8a58fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Creating volume 738b1a42-a44b-450e-8a7d-2e7df2fd542a {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:21:57 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:57 devstack sudo[82764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a 1073741824 Apr 13 17:21:57 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-41c8903e-bc85-4871-9e5c-bcbcc0b81022 req-f08bd70d-002f-4d20-a171-277e9ca3e71b tempest-VolumesSnapshotsTestJSON-12325253 None] Create snapshot completed successfully Apr 13 17:21:57 devstack sudo[82764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Acquiring lock "cinder-c23afc46-6800-417c-88b8-bf1357095d21-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "cinder-c23afc46-6800-417c-88b8-bf1357095d21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Acquiring lock "cinder-quobyte-0f98e67a-277a-416f-a9be-7e6065e21c0b" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "cinder-quobyte-0f98e67a-277a-416f-a9be-7e6065e21c0b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Acquiring lock "cinder-quobyte-c23afc46-6800-417c-88b8-bf1357095d21" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "cinder-quobyte-c23afc46-6800-417c-88b8-bf1357095d21" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Deleting offline snapshot c23afc46-6800-417c-88b8-bf1357095d21 of volume 0f98e67a-277a-416f-a9be-7e6065e21c0b {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] snapshot_file for this snap is: volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23cd58d-37da-4ec3-bf4b-3a6ceb8de5f2]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:57 devstack sudo[82774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 Apr 13 17:21:57 devstack sudo[82774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:57 devstack sudo[82764]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a 1073741824" returned: 0 in 0.553s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:57 devstack sudo[82777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a Apr 13 17:21:57 devstack sudo[82777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:58 devstack sudo[82777]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a" returned: 0 in 0.404s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.244s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2114007341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3ce64b-cb08-4921-b62a-aa2f596195f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a781f79ae36d454186fe5005d275c632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:21:56Z,use_quota=True,user_id='e0d76adc5a4c4bd8a33e8f13f1a89a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Creating volume 0d3ce64b-cb08-4921-b62a-aa2f596195f1 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:21:58 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:58 devstack sudo[82774]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21" returned: 0 in 0.610s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60128178-43e8-4668-b760-e16dcaf907c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:58 devstack sudo[82783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1 1073741824 Apr 13 17:21:58 devstack sudo[82783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726531b2-f6c3-4210-ab8c-9c3bdee9cbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f98e67a-277a-416f-a9be-7e6065e21c0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:21:58 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Volume volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a (738b1a42-a44b-450e-8a7d-2e7df2fd542a): created successfully Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726531b2-f6c3-4210-ab8c-9c3bdee9cbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Flow 'volume_create_manager' (244099a8-75ff-4854-98b5-bcae82619ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[677f2b28-1ea9-4026-ae49-5bc79dcc7b88]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:58 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-eeebe164-7d31-4e0b-afab-8a4b57ac74a8 tempest-VolumesTestJSON-1429156954 None] Created volume successfully. Apr 13 17:21:58 devstack sudo[82785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b Apr 13 17:21:58 devstack sudo[82785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:58 devstack sudo[82783]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1 1073741824" returned: 0 in 0.591s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:58 devstack sudo[82785]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b" returned: 0 in 0.566s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:58 devstack sudo[82795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1 Apr 13 17:21:58 devstack sudo[82795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:58 devstack sudo[82797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 Apr 13 17:21:58 devstack sudo[82797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:59 devstack sudo[82795]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1" returned: 0 in 0.477s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:21:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:21:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0363b9e-9a2e-4853-92df-3082024cdca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb20915-b344-4f92-bc9b-b44302da7637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:21:59 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Volume volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1 (0d3ce64b-cb08-4921-b62a-aa2f596195f1): created successfully Apr 13 17:21:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb20915-b344-4f92-bc9b-b44302da7637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:21:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Flow 'volume_create_manager' (08c7e0b3-519f-460c-b67d-09749674b8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:21:59 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-38989ed7-9019-4bd0-9c70-4de774731702 tempest-VolumesAdminNegativeTest-637329278 None] Created volume successfully. Apr 13 17:21:59 devstack sudo[82797]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21" returned: 0 in 0.526s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:21:59 devstack sudo[82803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21 Apr 13 17:21:59 devstack sudo[82803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:21:59 devstack sudo[82803]: pam_unix(sudo:session): session closed for user root Apr 13 17:21:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b.c23afc46-6800-417c-88b8-bf1357095d21" returned: 0 in 0.528s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:21:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "cinder-quobyte-c23afc46-6800-417c-88b8-bf1357095d21" released by "_delete_snapshot" :: held 2.344s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:21:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "cinder-quobyte-0f98e67a-277a-416f-a9be-7e6065e21c0b" released by "delete_snapshot" :: held 2.376s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:21:59 devstack cinder-volume[81998]: WARNING cinder.quota [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:21:59 devstack cinder-volume[81998]: WARNING cinder.quota [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.quota [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Created reservations ['6ca6e841-7104-4813-9856-08d0e8bba03b', 'bb90a8a7-6450-4cf4-9ce5-157a98664c8c', 'faf7c2ad-4364-4ca6-b642-b387f91a377d', 'ee056376-c265-49d8-a471-d26bd7ae48d9'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Acquiring lock "cinder-738b1a42-a44b-450e-8a7d-2e7df2fd542a-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Lock "cinder-738b1a42-a44b-450e-8a7d-2e7df2fd542a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Acquiring lock "cinder-quobyte-738b1a42-a44b-450e-8a7d-2e7df2fd542a" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:00 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Delete snapshot completed successfully. Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-87e32c1c-3749-47c6-b0b7-37c004f672c9 req-4b759aa6-df50-4e41-a3b1-5f7ce51ae426 tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "cinder-c23afc46-6800-417c-88b8-bf1357095d21-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Lock "cinder-quobyte-738b1a42-a44b-450e-8a7d-2e7df2fd542a" acquired by "delete_volume" :: waited 0.025s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9544402-869e-4c18-9ecb-793b00476900]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:00 devstack sudo[82808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a Apr 13 17:22:00 devstack sudo[82808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Acquiring lock "cinder-0d3ce64b-cb08-4921-b62a-aa2f596195f1-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Lock "cinder-0d3ce64b-cb08-4921-b62a-aa2f596195f1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Acquiring lock "cinder-quobyte-0d3ce64b-cb08-4921-b62a-aa2f596195f1" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Lock "cinder-quobyte-0d3ce64b-cb08-4921-b62a-aa2f596195f1" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ce1845-e407-4805-967d-f84c0231c3b2]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:00 devstack sudo[82811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1 Apr 13 17:22:00 devstack sudo[82811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:00 devstack sudo[82808]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a" returned: 0 in 0.595s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:00 devstack sudo[82816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a Apr 13 17:22:00 devstack sudo[82816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Acquiring lock "cinder-0f98e67a-277a-416f-a9be-7e6065e21c0b-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "cinder-0f98e67a-277a-416f-a9be-7e6065e21c0b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Acquiring lock "cinder-quobyte-0f98e67a-277a-416f-a9be-7e6065e21c0b" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "cinder-quobyte-0f98e67a-277a-416f-a9be-7e6065e21c0b" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[da31bec8-8f07-4cad-8c58-7e6776d8cffd]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:01 devstack sudo[82818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b Apr 13 17:22:01 devstack sudo[82818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:01 devstack sudo[82811]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1" returned: 0 in 0.902s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:01 devstack sudo[82825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1 Apr 13 17:22:01 devstack sudo[82825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:01 devstack sudo[82816]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-738b1a42-a44b-450e-8a7d-2e7df2fd542a" returned: 0 in 0.766s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Lock "cinder-quobyte-738b1a42-a44b-450e-8a7d-2e7df2fd542a" released by "delete_volume" :: held 1.384s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:01 devstack cinder-volume[81998]: WARNING cinder.quota [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Created reservations ['3925f54f-2b5f-4013-bb84-bb31954adae9', '7421c1da-62b5-451d-b753-c651f0216202', 'bf75e235-72b2-4e1d-b766-b5f276144431', '9dece729-cfe2-460f-a338-c8322c114432'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:01 devstack sudo[82832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:22:01 devstack sudo[82832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:01 devstack sudo[82818]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b" returned: 0 in 0.897s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:01 devstack sudo[82834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b Apr 13 17:22:01 devstack sudo[82834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:02 devstack sudo[82825]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0d3ce64b-cb08-4921-b62a-aa2f596195f1" returned: 0 in 0.818s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Lock "cinder-quobyte-0d3ce64b-cb08-4921-b62a-aa2f596195f1" released by "delete_volume" :: held 1.756s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Created reservations ['5c5c6d1e-6c13-4336-89eb-3f35fb4bfa27', '8ec1532d-347c-4731-ae6a-0a51027360d9', '2c0fbe59-1324-4092-922b-7282c579ffef', '10019188-b595-4196-89d5-e4213da34cc4'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Acquiring lock "cinder-4de7855a-e397-42e7-8cb0-dd109745c3f0-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:02 devstack sudo[82834]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:02 devstack sudo[82840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:22:02 devstack sudo[82840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Lock "cinder-4de7855a-e397-42e7-8cb0-dd109745c3f0-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0f98e67a-277a-416f-a9be-7e6065e21c0b" returned: 0 in 0.786s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "cinder-quobyte-0f98e67a-277a-416f-a9be-7e6065e21c0b" released by "delete_volume" :: held 1.739s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Acquiring lock "cinder-quobyte-4de7855a-e397-42e7-8cb0-dd109745c3f0" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Lock "cinder-quobyte-4de7855a-e397-42e7-8cb0-dd109745c3f0" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e84ecd2-27cb-4fb4-97e3-f2ab716469be]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4de7855a-e397-42e7-8cb0-dd109745c3f0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.quota [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Created reservations ['8eb650c9-f425-4ad8-a625-2070300dd1e8', 'dccb8ad5-fdc6-4dc2-bb2d-92f8304d3269', 'c508d021-be85-4022-9364-4ab4665f72da', 'c48bf6b0-0ba4-4887-801f-f688b9af2c4e'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:02 devstack sudo[82832]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 1.103s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:22:02 devstack sudo[82845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:22:02 devstack sudo[82845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Deleted volume successfully. Apr 13 17:22:02 devstack sudo[82844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4de7855a-e397-42e7-8cb0-dd109745c3f0 Apr 13 17:22:02 devstack sudo[82844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-55456d21-5a5f-4287-94a3-9498a195bd5d tempest-VolumesTestJSON-1429156954 None] Lock "cinder-738b1a42-a44b-450e-8a7d-2e7df2fd542a-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:03 devstack sudo[82845]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.516s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:03 devstack cinder-volume[81998]: DEBUG cinder.manager [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:22:03 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Deleted volume successfully. Apr 13 17:22:03 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-bec921ce-638d-4b15-961f-6c419a60ebc8 req-b8e8574b-8c59-4131-bbfd-65e04c9bdec2 tempest-VolumesSnapshotsTestJSON-12325253 None] Lock "cinder-0f98e67a-277a-416f-a9be-7e6065e21c0b-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:03 devstack sudo[82840]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 1.492s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:03 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:22:03 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Deleted volume successfully. Apr 13 17:22:03 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2f51820f-64bd-406c-8dfc-06b048233dd8 tempest-VolumesAdminNegativeTest-637329278 None] Lock "cinder-0d3ce64b-cb08-4921-b62a-aa2f596195f1-delete_volume" released by "delete_volume" :: held 3.587s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:04 devstack sudo[82844]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4de7855a-e397-42e7-8cb0-dd109745c3f0" returned: 0 in 1.428s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4de7855a-e397-42e7-8cb0-dd109745c3f0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:04 devstack sudo[82871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4de7855a-e397-42e7-8cb0-dd109745c3f0 Apr 13 17:22:04 devstack sudo[82871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:04 devstack sudo[82871]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4de7855a-e397-42e7-8cb0-dd109745c3f0" returned: 0 in 0.519s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Lock "cinder-quobyte-4de7855a-e397-42e7-8cb0-dd109745c3f0" released by "delete_volume" :: held 1.981s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Created reservations ['88a8db80-3453-4aaf-a55e-881cfcb1f3a0', '279775db-4aa0-4ba7-9073-36cbe43a7bfc', '0a7b94fb-f1db-48cd-8c42-cbfcfb240566', 'f19c1b24-0f6f-46b9-86ce-8b638eb0aaef'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Acquiring lock "cinder-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:04 devstack sudo[82904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:22:04 devstack sudo[82904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Lock "cinder-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Acquiring lock "cinder-quobyte-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Lock "cinder-quobyte-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b081b3-1c30-4058-a383-e78aa846dcdd]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:04 devstack sudo[82907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e Apr 13 17:22:04 devstack sudo[82907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:05 devstack sudo[82904]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.668s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:05 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:22:05 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Deleted volume successfully. Apr 13 17:22:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2236c309-f471-4975-b91a-82db027303b9 tempest-VolumesTestJSON-1429156954 None] Lock "cinder-4de7855a-e397-42e7-8cb0-dd109745c3f0-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:05 devstack sudo[82907]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e" returned: 0 in 0.630s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:05 devstack sudo[82917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e Apr 13 17:22:05 devstack sudo[82917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:05 devstack sudo[82917]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e" returned: 0 in 0.469s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Lock "cinder-quobyte-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e" released by "delete_volume" :: held 1.158s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:05 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Created reservations ['29cdb351-4e32-4651-9d2b-dc967400cf30', 'd7c506c0-bab7-4750-b18b-c959f5e3a8f6', 'b9e7b6ed-149c-43ef-a0e5-753d900cd134', '4d4f5deb-00a8-4261-8eb6-a41ace379a37'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:06 devstack sudo[82921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:22:06 devstack sudo[82921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:06 devstack sudo[82921]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.579s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:06 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:22:06 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Deleted volume successfully. Apr 13 17:22:06 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e4d1ff32-df04-411e-98ee-31281e21481c tempest-VolumesTestJSON-1429156954 None] Lock "cinder-92cc8044-6a09-4093-ae1a-d2fc6ad0ca4e-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:15 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-561261db-1f04-49ab-9023-c4ae486fff03 tempest-GroupSnapshotsTest-776228881 None] Group tempest-GroupSnapshotsTest-Group-1924036972: creating Apr 13 17:22:15 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-561261db-1f04-49ab-9023-c4ae486fff03 tempest-GroupSnapshotsTest-776228881 None] Group tempest-GroupSnapshotsTest-Group-1924036972: created successfully Apr 13 17:22:15 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-561261db-1f04-49ab-9023-c4ae486fff03 tempest-GroupSnapshotsTest-776228881 None] Create group completed successfully. Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Flow 'volume_create_manager' (55ce1d10-75be-4963-ae38-19f5a66cb913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0ab233-d37e-4aed-9190-95e22f0582bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0ab233-d37e-4aed-9190-95e22f0582bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-339308411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e80050-d537-44f6-a476-ce9139e9af01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90984ec4f4274a4db3d77ec4add48360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:22:16Z,use_quota=True,user_id='f7ed3fe1f7a642b181e3a019688c4351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95202511-34bb-49f1-a951-fdf53c0fdf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95202511-34bb-49f1-a951-fdf53c0fdf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4389b927-798b-4545-979b-a7e6995029f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4389b927-798b-4545-979b-a7e6995029f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5e80050-d537-44f6-a476-ce9139e9af01', 'volume_name': 'volume-a5e80050-d537-44f6-a476-ce9139e9af01', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e92077-8fa3-42b2-aa27-abbb754b2826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e92077-8fa3-42b2-aa27-abbb754b2826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a153fbd8-f833-4161-a0eb-c4a2cc168c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:15 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Volume a5e80050-d537-44f6-a476-ce9139e9af01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5e80050-d537-44f6-a476-ce9139e9af01', 'volume_size': 1} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-339308411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e80050-d537-44f6-a476-ce9139e9af01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90984ec4f4274a4db3d77ec4add48360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:22:16Z,use_quota=True,user_id='f7ed3fe1f7a642b181e3a019688c4351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Creating volume a5e80050-d537-44f6-a476-ce9139e9af01 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:22:15 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:22:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:15 devstack sudo[82984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01 1073741824 Apr 13 17:22:15 devstack sudo[82984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:15 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-cf98d1c1-258f-4c3d-9ffc-6c0bdfca6f46 tempest-GroupsV314Test-1721213561 None] Group tempest-GroupsV314Test-Group-2015177472: creating Apr 13 17:22:15 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-cf98d1c1-258f-4c3d-9ffc-6c0bdfca6f46 tempest-GroupsV314Test-1721213561 None] Group tempest-GroupsV314Test-Group-2015177472: created successfully Apr 13 17:22:16 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-cf98d1c1-258f-4c3d-9ffc-6c0bdfca6f46 tempest-GroupsV314Test-1721213561 None] Create group completed successfully. Apr 13 17:22:16 devstack sudo[82984]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01 1073741824" returned: 0 in 0.722s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:16 devstack sudo[82989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01 Apr 13 17:22:16 devstack sudo[82989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Flow 'volume_create_manager' (810f3e31-e0ef-405a-94dd-0b8aefb0a86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712114b9-f941-4fe1-8d9b-01f7b4487c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712114b9-f941-4fe1-8d9b-01f7b4487c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-935884845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff4f4c93-8c2f-4aeb-b327-8d692fb24846,host='devstack@QuobyteHD#QuobyteHD',id=5ad61597-bfc6-4526-9625-90759f41f2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b282c15ab8436b818b81ff2e6ce3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:22:17Z,use_quota=True,user_id='3e89342546e74cc3b0d111388328d672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(357693b0-f47b-4737-b28a-a5790711e3cb),volume_type_id=357693b0-f47b-4737-b28a-a5790711e3cb)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471c1a0e-f816-4d96-88fd-60857a2422d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471c1a0e-f816-4d96-88fd-60857a2422d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc640c6-5982-48af-a3bf-3e5d2a9612bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc640c6-5982-48af-a3bf-3e5d2a9612bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad61597-bfc6-4526-9625-90759f41f2a2', 'volume_name': 'volume-5ad61597-bfc6-4526-9625-90759f41f2a2', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec2ab98-08fd-450d-91c4-0ff95499ccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec2ab98-08fd-450d-91c4-0ff95499ccd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34468c79-7b71-4e19-aa68-d4348498c616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:16 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Volume 5ad61597-bfc6-4526-9625-90759f41f2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad61597-bfc6-4526-9625-90759f41f2a2', 'volume_size': 1} Apr 13 17:22:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:17 devstack sudo[82989]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01" returned: 0 in 0.539s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.278s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff4f4c93-8c2f-4aeb-b327-8d692fb24846,created_at=2026-04-13T15:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-935884845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff4f4c93-8c2f-4aeb-b327-8d692fb24846,host='devstack@QuobyteHD#QuobyteHD',id=5ad61597-bfc6-4526-9625-90759f41f2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b282c15ab8436b818b81ff2e6ce3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:22:17Z,use_quota=True,user_id='3e89342546e74cc3b0d111388328d672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(357693b0-f47b-4737-b28a-a5790711e3cb),volume_type_id=357693b0-f47b-4737-b28a-a5790711e3cb)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Creating volume 5ad61597-bfc6-4526-9625-90759f41f2a2 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:22:17 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a153fbd8-f833-4161-a0eb-c4a2cc168c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5e80050-d537-44f6-a476-ce9139e9af01', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0029f66-d192-46d7-a4c7-3f72e6395e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:17 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Volume volume-a5e80050-d537-44f6-a476-ce9139e9af01 (a5e80050-d537-44f6-a476-ce9139e9af01): created successfully Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0029f66-d192-46d7-a4c7-3f72e6395e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Flow 'volume_create_manager' (55ce1d10-75be-4963-ae38-19f5a66cb913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:22:17 devstack sudo[82993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 1073741824 Apr 13 17:22:17 devstack sudo[82993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:17 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e8544b13-7a13-4885-b828-1a6a6bbb883d tempest-DeleteServersTestJSON-1011191123 None] Created volume successfully. Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Flow 'volume_create_manager' (e14f44f7-d21f-40df-bfbe-f601491f9e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84433f7f-c31d-46e5-87a4-132db7624887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84433f7f-c31d-46e5-87a4-132db7624887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1971544696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31f250cb-2679-4723-8d27-a5567fa5548d,host='devstack@QuobyteHD#QuobyteHD',id=db87b3b8-1ce8-4d96-b4a6-57a5d032cffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bdd871f61f48f2836457f5b20a4d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:22:18Z,use_quota=True,user_id='baf095309ae5483fa0c1c22850a471c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d43d4be2-76ca-47f6-84d6-aed45b9c70d2),volume_type_id=d43d4be2-76ca-47f6-84d6-aed45b9c70d2)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91edd2ab-b979-464c-9069-2b6341dd4fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91edd2ab-b979-464c-9069-2b6341dd4fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd681e74-0416-477f-b04b-afe3b14584d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd681e74-0416-477f-b04b-afe3b14584d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db87b3b8-1ce8-4d96-b4a6-57a5d032cffb', 'volume_name': 'volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40582aa-d1bf-403e-af28-7d16f11c7add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40582aa-d1bf-403e-af28-7d16f11c7add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ac08de9-a39f-47f1-8a02-30401b25c118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:17 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Volume db87b3b8-1ce8-4d96-b4a6-57a5d032cffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb', 'volume_size': 1} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:17 devstack sudo[82993]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 1073741824" returned: 0 in 0.729s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:17 devstack sudo[82998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 Apr 13 17:22:17 devstack sudo[82998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:18 devstack sudo[82998]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2" returned: 0 in 0.530s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.749s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=31f250cb-2679-4723-8d27-a5567fa5548d,created_at=2026-04-13T15:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1971544696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31f250cb-2679-4723-8d27-a5567fa5548d,host='devstack@QuobyteHD#QuobyteHD',id=db87b3b8-1ce8-4d96-b4a6-57a5d032cffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bdd871f61f48f2836457f5b20a4d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:22:18Z,use_quota=True,user_id='baf095309ae5483fa0c1c22850a471c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d43d4be2-76ca-47f6-84d6-aed45b9c70d2),volume_type_id=d43d4be2-76ca-47f6-84d6-aed45b9c70d2)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Creating volume db87b3b8-1ce8-4d96-b4a6-57a5d032cffb {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:22:18 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34468c79-7b71-4e19-aa68-d4348498c616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad61597-bfc6-4526-9625-90759f41f2a2', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde83c19-6158-414b-8165-88e50fd70c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:18 devstack sudo[83008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb 1073741824 Apr 13 17:22:18 devstack sudo[83008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:18 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Volume volume-5ad61597-bfc6-4526-9625-90759f41f2a2 (5ad61597-bfc6-4526-9625-90759f41f2a2): created successfully Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde83c19-6158-414b-8165-88e50fd70c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Flow 'volume_create_manager' (810f3e31-e0ef-405a-94dd-0b8aefb0a86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:22:18 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-2cc422b1-106f-4d79-ab6f-7697b29ac494 tempest-GroupSnapshotsTest-776228881 None] Created volume successfully. Apr 13 17:22:19 devstack sudo[83008]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb 1073741824" returned: 0 in 0.581s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:19 devstack sudo[83013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb Apr 13 17:22:19 devstack sudo[83013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:19 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] GroupSnapshot a98aabff-de91-4929-924e-a5e17bcefe25: creating. Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] Group snapshot a98aabff-de91-4929-924e-a5e17bcefe25: creating. {{(pid=81998) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:19 devstack sudo[83013]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb" returned: 0 in 0.613s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.317s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ac08de9-a39f-47f1-8a02-30401b25c118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc11955-e71f-4ea9-bdf9-149510c8af61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:19 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Volume volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb (db87b3b8-1ce8-4d96-b4a6-57a5d032cffb): created successfully Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc11955-e71f-4ea9-bdf9-149510c8af61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Flow 'volume_create_manager' (e14f44f7-d21f-40df-bfbe-f601491f9e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] Creating offline snapshot def94614-8497-48a7-b317-8bdec9bfcdd9 of volume 5ad61597-bfc6-4526-9625-90759f41f2a2 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:22:19 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-02e3f1af-0e3b-4b7c-bf2d-b423c1dce46d tempest-GroupsV314Test-1721213561 None] Created volume successfully. Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f4a894-0cad-4b78-be13-939a85c16966]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:19 devstack sudo[83017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 Apr 13 17:22:19 devstack sudo[83017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:20 devstack sudo[83017]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2" returned: 0 in 0.601s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:20 devstack sudo[83023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 1G Apr 13 17:22:20 devstack sudo[83023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:20 devstack sudo[83023]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 1G" returned: 0 in 0.589s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad61597-bfc6-4526-9625-90759f41f2a2 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:20 devstack sudo[83031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad61597-bfc6-4526-9625-90759f41f2a2 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 Apr 13 17:22:20 devstack sudo[83031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:21 devstack sudo[83031]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad61597-bfc6-4526-9625-90759f41f2a2 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9" returned: 0 in 0.449s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:21 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:22:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:21 devstack sudo[83045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 Apr 13 17:22:21 devstack sudo[83045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:22 devstack sudo[83045]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9" returned: 0 in 0.701s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:22 devstack sudo[83050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.info Apr 13 17:22:22 devstack sudo[83050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:22 devstack sudo[83050]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.info" returned: 0 in 0.595s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:22 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:22:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:22 devstack sudo[83064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.info Apr 13 17:22:22 devstack sudo[83064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:22 devstack cinder-volume[81998]: WARNING py.warnings [req-dd2e1343-b17d-4a24-9e19-b2648a78124e req-7d4a45d9-a651-4b79-9750-c3129a29a2e8 tempest-DeleteServersTestJSON-1011191123 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 13 17:22:22 devstack cinder-volume[81998]: .first() Apr 13 17:22:22 devstack cinder-volume[81998]: Apr 13 17:22:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-dd2e1343-b17d-4a24-9e19-b2648a78124e req-7d4a45d9-a651-4b79-9750-c3129a29a2e8 tempest-DeleteServersTestJSON-1011191123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:23 devstack sudo[83064]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.info" returned: 0 in 0.525s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.546s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.379s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:23 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Cloning volume db87b3b8-1ce8-4d96-b4a6-57a5d032cffb to volume beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b Apr 13 17:22:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Creating offline snapshot c6b74281-9f6c-4b9d-93dc-c319e2f17748 of volume db87b3b8-1ce8-4d96-b4a6-57a5d032cffb {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:22:23 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[68094f20-df9a-4b0f-8282-efb38ad75288]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:23 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d55446c2-a9cd-4d44-953f-3103ce3e8ca9 tempest-GroupSnapshotsTest-776228881 None] group_snapshot a98aabff-de91-4929-924e-a5e17bcefe25: created successfully Apr 13 17:22:23 devstack sudo[83068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb Apr 13 17:22:23 devstack sudo[83068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:23 devstack sudo[83068]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb" returned: 0 in 0.519s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:23 devstack sudo[83074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 1G Apr 13 17:22:23 devstack sudo[83074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:24 devstack sudo[83074]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 1G" returned: 0 in 0.547s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:24 devstack sudo[83079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 Apr 13 17:22:24 devstack sudo[83079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:24 devstack sudo[83079]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748" returned: 0 in 0.515s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:24 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:22:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:24 devstack sudo[83084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 Apr 13 17:22:24 devstack sudo[83084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:25 devstack sudo[83084]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748" returned: 0 in 0.568s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:25 devstack sudo[83088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.info Apr 13 17:22:25 devstack sudo[83088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:26 devstack sudo[83088]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.info" returned: 0 in 0.510s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:26 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:26 devstack sudo[83091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.info Apr 13 17:22:26 devstack sudo[83091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:26 devstack sudo[83091]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.info" returned: 0 in 0.464s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Acquiring lock "cinder-quobyte-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Lock "cinder-quobyte-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] snapshot: c6b74281-9f6c-4b9d-93dc-c319e2f17748, volume: beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3968f246-7413-4fbd-b361-947c841c12be]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:26 devstack sudo[83094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 Apr 13 17:22:26 devstack sudo[83094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:27 devstack sudo[83094]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748" returned: 0 in 0.531s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:22:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:22:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:22:27 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c13240-ba24-485a-b46a-0180d770f98f]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:27 devstack sudo[83099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb Apr 13 17:22:27 devstack sudo[83099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:27 devstack sudo[83099]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb" returned: 0 in 0.550s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:27 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:22:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:27 devstack sudo[83104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b Apr 13 17:22:27 devstack sudo[83104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:30 devstack sudo[83104]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b" returned: 0 in 3.345s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:30 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f956507-df86-48f2-8a40-f55db2057c98]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:31 devstack sudo[83165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb Apr 13 17:22:31 devstack sudo[83165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:31 devstack sudo[83165]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb" returned: 0 in 0.732s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:31 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb, size 1024.00 MB, duration 3.35 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:22:31 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Converted 1024.00 MB image at 305.94 MB/s Apr 13 17:22:31 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:22:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:31 devstack sudo[83170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b Apr 13 17:22:31 devstack sudo[83170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:32 devstack sudo[83170]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b" returned: 0 in 0.487s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Lock "cinder-quobyte-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b" released by "_copy_volume_from_snapshot" :: held 5.699s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Acquiring lock "cinder-quobyte-c6b74281-9f6c-4b9d-93dc-c319e2f17748" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Lock "cinder-quobyte-c6b74281-9f6c-4b9d-93dc-c319e2f17748" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Deleting offline snapshot c6b74281-9f6c-4b9d-93dc-c319e2f17748 of volume db87b3b8-1ce8-4d96-b4a6-57a5d032cffb {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:22:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] snapshot_file for this snap is: volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:22:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[45241708-3588-4281-8829-e1a4aacc4827]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:32 devstack sudo[83179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 Apr 13 17:22:32 devstack sudo[83179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:32 devstack sudo[83179]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748" returned: 0 in 0.593s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:22:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dca0721-4f7d-44b9-a8b9-f63f99c5b8a0]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:32 devstack sudo[83185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb Apr 13 17:22:32 devstack sudo[83185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:33 devstack cinder-volume[81998]: DEBUG oslo_service.periodic_task [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:22:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:33 devstack sudo[83191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:22:33 devstack sudo[83191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:33 devstack sudo[83185]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb" returned: 0 in 0.768s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:33 devstack sudo[83193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 Apr 13 17:22:33 devstack sudo[83193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:34 devstack sudo[83191]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.635s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:22:34 devstack sudo[83193]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748" returned: 0 in 0.628s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:34 devstack sudo[83199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748 Apr 13 17:22:34 devstack sudo[83199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:34 devstack sudo[83199]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb.c6b74281-9f6c-4b9d-93dc-c319e2f17748" returned: 0 in 0.543s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Lock "cinder-quobyte-c6b74281-9f6c-4b9d-93dc-c319e2f17748" released by "_delete_snapshot" :: held 2.600s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.625s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-dd2e1343-b17d-4a24-9e19-b2648a78124e req-7d4a45d9-a651-4b79-9750-c3129a29a2e8 tempest-DeleteServersTestJSON-1011191123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.094s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:34 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c231ea-a817-48e0-91bf-f3f1d655cc93]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-dd2e1343-b17d-4a24-9e19-b2648a78124e req-7d4a45d9-a651-4b79-9750-c3129a29a2e8 tempest-DeleteServersTestJSON-1011191123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:34 devstack sudo[83202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01 Apr 13 17:22:34 devstack sudo[83202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:34 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-92e4d880-7436-4313-9a5b-dedb370bbaf0 tempest-GroupsV314Test-1721213561 None] Create group from source-group-31f250cb-2679-4723-8d27-a5567fa5548d completed successfully. Apr 13 17:22:35 devstack sudo[83202]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-dd2e1343-b17d-4a24-9e19-b2648a78124e req-7d4a45d9-a651-4b79-9750-c3129a29a2e8 tempest-DeleteServersTestJSON-1011191123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01" returned: 0 in 0.682s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-dd2e1343-b17d-4a24-9e19-b2648a78124e req-7d4a45d9-a651-4b79-9750-c3129a29a2e8 tempest-DeleteServersTestJSON-1011191123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.704s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.918s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-def94614-8497-48a7-b317-8bdec9bfcdd9-bd9fc50a-807d-493b-b27d-ab93b628d26c" by "_create_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Acquiring lock "cinder-quobyte-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-def94614-8497-48a7-b317-8bdec9bfcdd9-bd9fc50a-807d-493b-b27d-ab93b628d26c" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Creating volume bd9fc50a-807d-493b-b27d-ab93b628d26c from snapshot def94614-8497-48a7-b317-8bdec9bfcdd9 {{(pid=81998) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-bd9fc50a-807d-493b-b27d-ab93b628d26c" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Lock "cinder-quobyte-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b" acquired by "delete_volume" :: waited 0.032s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[163a56c6-c896-454f-8e36-1e816c362994]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-bd9fc50a-807d-493b-b27d-ab93b628d26c" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] snapshot: def94614-8497-48a7-b317-8bdec9bfcdd9, volume: bd9fc50a-807d-493b-b27d-ab93b628d26c, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-dd2e1343-b17d-4a24-9e19-b2648a78124e req-7d4a45d9-a651-4b79-9750-c3129a29a2e8 tempest-DeleteServersTestJSON-1011191123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6', 'name': 'volume-a5e80050-d537-44f6-a476-ce9139e9af01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd0aa694-18eb-4044-84f7-53efbe8067e9', 'enforce_multipath': True} {{(pid=81998) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1d0ab9-9a91-489c-9b35-bd4492fc1337]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:35 devstack sudo[83210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b Apr 13 17:22:35 devstack sudo[83210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:35 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-dd2e1343-b17d-4a24-9e19-b2648a78124e req-7d4a45d9-a651-4b79-9750-c3129a29a2e8 tempest-DeleteServersTestJSON-1011191123 None] attachment_update completed successfully. Apr 13 17:22:35 devstack sudo[83211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 Apr 13 17:22:35 devstack sudo[83211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:36 devstack sudo[83210]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b" returned: 0 in 0.600s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:36 devstack sudo[83219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b Apr 13 17:22:36 devstack sudo[83219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:36 devstack sudo[83211]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9" returned: 0 in 0.653s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ad61597-bfc6-4526-9625-90759f41f2a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:22:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:22:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:22:36 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[71feadbe-fa60-45ae-9d0b-a8acb5f6f7e3]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:36 devstack sudo[83223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 Apr 13 17:22:36 devstack sudo[83223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:37 devstack sudo[83219]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b" returned: 0 in 0.947s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Lock "cinder-quobyte-beb76ab6-c9ba-466a-9ea5-8ce3e8e7dd8b" released by "delete_volume" :: held 1.576s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Created reservations ['e3a4f351-268a-497f-984d-3e1b4c3db727'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:37 devstack cinder-volume[81998]: WARNING cinder.quota [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-117665656 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-117665656, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:22:37 devstack cinder-volume[81998]: WARNING cinder.quota [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-117665656 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-117665656, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Created reservations ['9f3bfeea-fdaf-43b5-8790-f2aa944c42f3', 'bbcb8da1-06c5-4519-b73e-5b5291048e30', 'f7141b2b-46e7-45ac-8cce-12a55d9d2484', '1818d109-4594-476f-a14e-00b0285d3e3e'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:37 devstack sudo[83223]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2" returned: 0 in 0.960s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:37 devstack sudo[83300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c Apr 13 17:22:37 devstack sudo[83300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:37 devstack sudo[83302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:22:37 devstack sudo[83302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:37 devstack sudo[83302]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.483s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:37 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:22:37 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-5b2f0fef-0084-46bf-8a92-83fe3fab599a tempest-GroupsV314Test-1721213561 None] Delete group completed successfully. Apr 13 17:22:38 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Acquiring lock "cinder-quobyte-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:38 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Lock "cinder-quobyte-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb" acquired by "delete_volume" :: waited 0.061s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:38 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1754f836-ce9e-412e-96e3-06de7f070418]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:38 devstack sudo[83634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb Apr 13 17:22:38 devstack sudo[83634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:40 devstack sudo[83300]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c" returned: 0 in 2.962s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:40 devstack sudo[83634]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb" returned: 0 in 1.773s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:40 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[475d5159-cc28-4d04-b7f8-77a528847a8e]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:40 devstack sudo[83639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb Apr 13 17:22:40 devstack sudo[83639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:40 devstack sudo[83640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 Apr 13 17:22:40 devstack sudo[83640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:40 devstack sudo[83639]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb" returned: 0 in 0.511s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:40 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Lock "cinder-quobyte-db87b3b8-1ce8-4d96-b4a6-57a5d032cffb" released by "delete_volume" :: held 2.377s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:40 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Created reservations ['13bf6cc1-38a1-4c4f-94f1-6efeeebcb9aa'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:40 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Created reservations ['024b6916-0c9f-41e4-851d-480cb28b81fb', 'a4ebbb85-ca19-49e3-9c63-a51f332e85b7', '7c0246ec-5d3e-44d1-abe3-be1d4313a92b', '6f2bc79a-e4e7-43b8-9e75-2f05c648b07d'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:41 devstack sudo[83640]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2" returned: 0 in 0.736s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2, size 1024.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:22:41 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Converted 1024.00 MB image at 345.61 MB/s Apr 13 17:22:41 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:41 devstack sudo[83647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:22:41 devstack sudo[83647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:41 devstack sudo[83648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c Apr 13 17:22:41 devstack sudo[83648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:41 devstack sudo[83648]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c" returned: 0 in 0.535s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-bd9fc50a-807d-493b-b27d-ab93b628d26c" released by "_copy_volume_from_snapshot" :: held 5.959s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-def94614-8497-48a7-b317-8bdec9bfcdd9-bd9fc50a-807d-493b-b27d-ab93b628d26c" released by "_create_volume_from_snapshot" :: held 6.007s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.042s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:41 devstack sudo[83647]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.621s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:41 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:22:41 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-5010a611-192d-4d1f-b5c5-57cc7aafa7f7 tempest-GroupsV314Test-1721213561 None] Delete group completed successfully. Apr 13 17:22:41 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-24b51e5c-5c02-4f83-b678-a34a3148f4cc tempest-GroupSnapshotsTest-776228881 None] Create group from source-snapshot-a98aabff-de91-4929-924e-a5e17bcefe25 completed successfully. Apr 13 17:22:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-bd9fc50a-807d-493b-b27d-ab93b628d26c" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-bd9fc50a-807d-493b-b27d-ab93b628d26c" acquired by "delete_volume" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:42 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e985f2fc-ee78-443c-9866-128a37ac1d1c]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:42 devstack sudo[83661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c Apr 13 17:22:42 devstack sudo[83661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:43 devstack sudo[83661]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c" returned: 0 in 0.789s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:43 devstack sudo[83688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c Apr 13 17:22:43 devstack sudo[83688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:43 devstack sudo[83688]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-bd9fc50a-807d-493b-b27d-ab93b628d26c" returned: 0 in 0.560s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:43 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-bd9fc50a-807d-493b-b27d-ab93b628d26c" released by "delete_volume" :: held 1.403s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:43 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=97,cinder:UPDATE=104,cinder:DELETE=7,cinder:INSERT=20 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:22:43 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=95,cinder:INSERT=26,cinder:UPDATE=104,cinder:DELETE=7 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:22:43 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Created reservations ['99fd5972-6514-43ac-a118-907e46253119'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:43 devstack cinder-volume[81998]: WARNING cinder.quota [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-351869684 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-351869684, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:22:43 devstack cinder-volume[81998]: WARNING cinder.quota [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-351869684 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-351869684, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:22:43 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Created reservations ['746f1fea-a8b8-4ded-a433-447c1639e43f', '89bace6c-b7d3-4f30-bad4-b206b0d17614', 'f10a2eb6-b4f8-4aeb-bbc8-7ac9fe4b9b0c', '7cf6f0f8-ab94-4a1e-b41b-86954ead9d13'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:44 devstack sudo[83732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:22:44 devstack sudo[83732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:44 devstack sudo[83732]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.582s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:22:44 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-53b9f94d-ed2e-474f-8817-10b02a461fd4 tempest-GroupSnapshotsTest-776228881 None] Delete group completed successfully. Apr 13 17:22:44 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] group_snapshot a98aabff-de91-4929-924e-a5e17bcefe25: deleting Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] group_snapshot a98aabff-de91-4929-924e-a5e17bcefe25: deleting {{(pid=81998) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-5ad61597-bfc6-4526-9625-90759f41f2a2" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-5ad61597-bfc6-4526-9625-90759f41f2a2" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-def94614-8497-48a7-b317-8bdec9bfcdd9" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-def94614-8497-48a7-b317-8bdec9bfcdd9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Deleting offline snapshot def94614-8497-48a7-b317-8bdec9bfcdd9 of volume 5ad61597-bfc6-4526-9625-90759f41f2a2 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] snapshot_file for this snap is: volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a62a4d-4215-4ba1-b5c5-4cf1c0c29722]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:44 devstack sudo[83738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 Apr 13 17:22:44 devstack sudo[83738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:45 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-336d70f8-dbb2-4964-ba4b-43e2a7d959c1 req-1ee220c9-2d24-4240-aba7-fd3e0def514e tempest-DeleteServersTestJSON-1011191123 None] Terminate volume connection completed successfully. Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-336d70f8-dbb2-4964-ba4b-43e2a7d959c1 req-1ee220c9-2d24-4240-aba7-fd3e0def514e tempest-DeleteServersTestJSON-1011191123 None] Deleting attachment dd0aa694-18eb-4044-84f7-53efbe8067e9. {{(pid=81998) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 17:22:45 devstack sudo[83738]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9" returned: 0 in 0.596s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ad61597-bfc6-4526-9625-90759f41f2a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cf5e9e-8dd9-4cf5-bbc4-3baa3d252152]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:45 devstack sudo[83745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 Apr 13 17:22:45 devstack sudo[83745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Flow 'volume_create_manager' (b40e155a-4abe-4ce2-b3f8-914e11cb8366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020f7eab-7612-4fcc-bb0e-c79ab8a1fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020f7eab-7612-4fcc-bb0e-c79ab8a1fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-682477014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e78ca13-cb89-4920-a936-006e1810d4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964db9f3b01d4b65ab8c35b55ef0002c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:22:46Z,use_quota=True,user_id='4e487932a5244249999aeb233533deb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c6c193-3b58-412d-9a19-249820a96947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c6c193-3b58-412d-9a19-249820a96947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2e0c87-3549-4e97-88b5-62c03d41ddf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2e0c87-3549-4e97-88b5-62c03d41ddf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e78ca13-cb89-4920-a936-006e1810d4dc', 'volume_name': 'volume-1e78ca13-cb89-4920-a936-006e1810d4dc', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dded0550-0cf4-4d7c-80e7-8bd572f1ebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dded0550-0cf4-4d7c-80e7-8bd572f1ebf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffebe01-fa20-4b53-9eb7-3390df02eb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:45 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Volume 1e78ca13-cb89-4920-a936-006e1810d4dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e78ca13-cb89-4920-a936-006e1810d4dc', 'volume_size': 1} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-682477014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e78ca13-cb89-4920-a936-006e1810d4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964db9f3b01d4b65ab8c35b55ef0002c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:22:46Z,use_quota=True,user_id='4e487932a5244249999aeb233533deb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Creating volume 1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:22:45 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:22:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:46 devstack sudo[83748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc 1073741824 Apr 13 17:22:46 devstack sudo[83748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:46 devstack sudo[83745]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2" returned: 0 in 0.576s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:46 devstack sudo[83752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 Apr 13 17:22:46 devstack sudo[83752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:46 devstack sudo[83748]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc 1073741824" returned: 0 in 0.578s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:46 devstack sudo[83763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc Apr 13 17:22:46 devstack sudo[83763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:46 devstack sudo[83752]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9" returned: 0 in 0.523s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:46 devstack sudo[83765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9 Apr 13 17:22:46 devstack sudo[83765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:47 devstack sudo[83763]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc" returned: 0 in 0.474s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffebe01-fa20-4b53-9eb7-3390df02eb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e78ca13-cb89-4920-a936-006e1810d4dc', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:47 devstack sudo[83765]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce5614b-5e4b-4fab-b236-2fc6af08e118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2.def94614-8497-48a7-b317-8bdec9bfcdd9" returned: 0 in 0.457s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:47 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Volume volume-1e78ca13-cb89-4920-a936-006e1810d4dc (1e78ca13-cb89-4920-a936-006e1810d4dc): created successfully Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce5614b-5e4b-4fab-b236-2fc6af08e118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Flow 'volume_create_manager' (b40e155a-4abe-4ce2-b3f8-914e11cb8366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-def94614-8497-48a7-b317-8bdec9bfcdd9" released by "_delete_snapshot" :: held 2.221s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:47 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b855384f-8b2d-4f70-9e2b-ab7c01c17b7a tempest-SnapshotsActionsTest-584482458 None] Created volume successfully. Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-5ad61597-bfc6-4526-9625-90759f41f2a2" released by "delete_snapshot" :: held 2.236s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:47 devstack cinder-volume[81998]: WARNING cinder.quota [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-351869684 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-351869684, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] Created reservations ['621e8e36-fc7f-46e5-a0ed-f3eb6de74d52', '795edc2f-0e1e-43c6-a2b5-7f716b3f226f', '9a860725-4a8e-4732-b934-983a62efcd5b', '922ee546-10ba-4f03-bcbf-be057a3b3d9f'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:47 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e3a1e73a-9a6e-42b5-a5b2-f435b11c05a9 tempest-GroupSnapshotsTest-776228881 None] group_snapshot a98aabff-de91-4929-924e-a5e17bcefe25: deleted successfully Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-5ad61597-bfc6-4526-9625-90759f41f2a2" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-5ad61597-bfc6-4526-9625-90759f41f2a2" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8340736b-c9fc-4439-ab3a-62017dd20e02]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:47 devstack sudo[83769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 Apr 13 17:22:47 devstack sudo[83769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:48 devstack sudo[83769]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2" returned: 0 in 0.642s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:48 devstack sudo[83801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2 Apr 13 17:22:48 devstack sudo[83801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] Creating offline snapshot a7c357d7-1aca-4cc5-8569-384f41b2b2b3 of volume 1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a03937-9054-4abc-a459-4458f74f9de6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:48 devstack sudo[83804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc Apr 13 17:22:48 devstack sudo[83804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Acquiring lock "cinder-a5e80050-d537-44f6-a476-ce9139e9af01-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Lock "cinder-a5e80050-d537-44f6-a476-ce9139e9af01-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Acquiring lock "cinder-quobyte-a5e80050-d537-44f6-a476-ce9139e9af01" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Lock "cinder-quobyte-a5e80050-d537-44f6-a476-ce9139e9af01" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[896f3053-2e02-474c-9a38-66205a0dd136]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:48 devstack sudo[83801]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5ad61597-bfc6-4526-9625-90759f41f2a2" returned: 0 in 0.695s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-5ad61597-bfc6-4526-9625-90759f41f2a2" released by "delete_volume" :: held 1.389s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:48 devstack sudo[83808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01 Apr 13 17:22:48 devstack sudo[83808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Created reservations ['19b63991-9126-466b-b83d-801a99986610'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:48 devstack cinder-volume[81998]: WARNING cinder.db.sqlalchemy.api [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-351869684'] Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Created reservations ['ec8097ce-1130-4803-a635-10d463ee26c1', '498fef6c-6dea-44c8-99e9-9fb7f94d2398', 'b9a0ed7f-359d-4e99-8c94-bd3074ad5321', '6ec2fe67-c89c-495e-8d2c-bc143e59bb78'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:49 devstack sudo[83810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:22:49 devstack sudo[83810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:49 devstack sudo[83804]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc" returned: 0 in 0.663s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:49 devstack sudo[83815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 1G Apr 13 17:22:49 devstack sudo[83815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:49 devstack sudo[83808]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01" returned: 0 in 0.698s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:49 devstack sudo[83821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01 Apr 13 17:22:49 devstack sudo[83821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:49 devstack sudo[83810]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.512s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:49 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:22:49 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-6d181236-45f4-4b3f-b890-68d58896e4a2 tempest-GroupSnapshotsTest-776228881 None] Delete group completed successfully. Apr 13 17:22:49 devstack sudo[83815]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 1G" returned: 0 in 0.711s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:49 devstack sudo[83826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:22:49 devstack sudo[83826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:50 devstack sudo[83821]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a5e80050-d537-44f6-a476-ce9139e9af01" returned: 0 in 0.662s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Lock "cinder-quobyte-a5e80050-d537-44f6-a476-ce9139e9af01" released by "delete_volume" :: held 1.425s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Created reservations ['36bd226a-e0b4-4c5d-a430-27d37d98f5a7', '3a4d66be-3cef-4ebe-928f-27175823073d', '0ed98dfe-700f-4644-a7f2-914e5ec5e54a', 'b0db296b-94cb-4360-8101-937fd38a54a2'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:22:50 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ecf54f8e-7a5d-4bf6-b512-75687e0bfe6d tempest-GroupSnapshotsTest-776228881 None] Group tempest-GroupSnapshotsTest-Group-1836787811: creating Apr 13 17:22:50 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ecf54f8e-7a5d-4bf6-b512-75687e0bfe6d tempest-GroupSnapshotsTest-776228881 None] Group tempest-GroupSnapshotsTest-Group-1836787811: created successfully Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:50 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ecf54f8e-7a5d-4bf6-b512-75687e0bfe6d tempest-GroupSnapshotsTest-776228881 None] Create group completed successfully. Apr 13 17:22:50 devstack sudo[83830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:22:50 devstack sudo[83830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:50 devstack sudo[83826]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 0.644s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:50 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 is being set with open permissions: ugo+rw Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:50 devstack sudo[83835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:22:50 devstack sudo[83835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:50 devstack sudo[83830]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.575s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:22:50 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Deleted volume successfully. Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-05b525c4-7038-4d73-a33b-a58de5e99271 tempest-DeleteServersTestJSON-1011191123 None] Lock "cinder-a5e80050-d537-44f6-a476-ce9139e9af01-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:22:50 devstack sudo[83835]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 0.439s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:51 devstack sudo[83841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.info Apr 13 17:22:51 devstack sudo[83841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:51 devstack sudo[83841]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.info" returned: 0 in 0.602s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:51 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.info is being set with open permissions: ugo+rw Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:51 devstack sudo[83844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.info Apr 13 17:22:51 devstack sudo[83844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Flow 'volume_create_manager' (a762c164-9281-4c99-a122-054b695a635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525af37a-daf8-47c4-b90e-7a3f80066e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525af37a-daf8-47c4-b90e-7a3f80066e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-133026380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da499bac-6457-49ca-9f91-e18d9131098f,host='devstack@QuobyteHD#QuobyteHD',id=3e7d5533-25c2-419b-9e04-a443666c8907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b282c15ab8436b818b81ff2e6ce3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:22:52Z,use_quota=True,user_id='3e89342546e74cc3b0d111388328d672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(519f513e-0083-4d1d-b4b2-e3f25095c56d),volume_type_id=519f513e-0083-4d1d-b4b2-e3f25095c56d)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd90f24f-9a24-4e98-8a7c-68dd84495cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd90f24f-9a24-4e98-8a7c-68dd84495cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f7e02e-4e9f-4200-9c98-944961a7525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f7e02e-4e9f-4200-9c98-944961a7525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e7d5533-25c2-419b-9e04-a443666c8907', 'volume_name': 'volume-3e7d5533-25c2-419b-9e04-a443666c8907', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd0461b-da1e-4fd2-b963-c2d01e41479d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd0461b-da1e-4fd2-b963-c2d01e41479d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8ed24d-1a76-479a-af9c-bd63849b05c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:51 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Volume 3e7d5533-25c2-419b-9e04-a443666c8907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e7d5533-25c2-419b-9e04-a443666c8907', 'volume_size': 1} Apr 13 17:22:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:52 devstack sudo[83844]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.info" returned: 0 in 0.490s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.665s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.303s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=da499bac-6457-49ca-9f91-e18d9131098f,created_at=2026-04-13T15:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-133026380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da499bac-6457-49ca-9f91-e18d9131098f,host='devstack@QuobyteHD#QuobyteHD',id=3e7d5533-25c2-419b-9e04-a443666c8907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b282c15ab8436b818b81ff2e6ce3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:22:52Z,use_quota=True,user_id='3e89342546e74cc3b0d111388328d672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(519f513e-0083-4d1d-b4b2-e3f25095c56d),volume_type_id=519f513e-0083-4d1d-b4b2-e3f25095c56d)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Creating volume 3e7d5533-25c2-419b-9e04-a443666c8907 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:22:52 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:52 devstack sudo[83849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 1073741824 Apr 13 17:22:52 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d6d5bcd2-b288-4ba8-b327-a5daad70b32d tempest-SnapshotsActionsTest-584482458 None] Create snapshot completed successfully Apr 13 17:22:52 devstack sudo[83849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:52 devstack sudo[83849]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 1073741824" returned: 0 in 0.817s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:52 devstack sudo[83861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 Apr 13 17:22:52 devstack sudo[83861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:53 devstack sudo[83861]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907" returned: 0 in 0.609s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:22:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.388s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] Creating offline snapshot 774be475-b936-4945-87c9-d88a6c98af13 of volume 1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:22:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8ed24d-1a76-479a-af9c-bd63849b05c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e7d5533-25c2-419b-9e04-a443666c8907', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf07caf-30cd-4e1e-b0b0-7586e4b0c365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:53 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5099a9-40e5-4a22-82da-be21c590e308]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:53 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Volume volume-3e7d5533-25c2-419b-9e04-a443666c8907 (3e7d5533-25c2-419b-9e04-a443666c8907): created successfully Apr 13 17:22:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf07caf-30cd-4e1e-b0b0-7586e4b0c365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Flow 'volume_create_manager' (a762c164-9281-4c99-a122-054b695a635c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:22:53 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-133f2253-3ef6-4ad2-923e-c4cad19b364b tempest-GroupSnapshotsTest-776228881 None] Created volume successfully. Apr 13 17:22:53 devstack sudo[83864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:22:53 devstack sudo[83864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:54 devstack sudo[83864]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 0.890s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:54 devstack sudo[83896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 1G Apr 13 17:22:54 devstack sudo[83896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Flow 'volume_create_manager' (16150674-e157-4c6c-969b-27c7ccc2f6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad221aa-857f-4802-ae68-d95495d7f627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad221aa-857f-4802-ae68-d95495d7f627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-714639404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da499bac-6457-49ca-9f91-e18d9131098f,host='devstack@QuobyteHD#QuobyteHD',id=2564b966-99c0-43ca-b25b-24048e7b4373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b282c15ab8436b818b81ff2e6ce3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:22:55Z,use_quota=True,user_id='3e89342546e74cc3b0d111388328d672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(519f513e-0083-4d1d-b4b2-e3f25095c56d),volume_type_id=519f513e-0083-4d1d-b4b2-e3f25095c56d)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6078ec-d26f-42c0-b1bc-63fc71c0b693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6078ec-d26f-42c0-b1bc-63fc71c0b693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ee40c0-c03c-409a-a3a3-30f597b188f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ee40c0-c03c-409a-a3a3-30f597b188f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2564b966-99c0-43ca-b25b-24048e7b4373', 'volume_name': 'volume-2564b966-99c0-43ca-b25b-24048e7b4373', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccc660a-1f73-4a76-ac04-0b5b6dadb83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccc660a-1f73-4a76-ac04-0b5b6dadb83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0f007d-6af0-47c4-8e82-77fcaa0cbef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:54 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Volume 2564b966-99c0-43ca-b25b-24048e7b4373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2564b966-99c0-43ca-b25b-24048e7b4373', 'volume_size': 1} Apr 13 17:22:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:55 devstack sudo[83896]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 1G" returned: 0 in 0.643s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:55 devstack sudo[83902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 Apr 13 17:22:55 devstack sudo[83902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:55 devstack sudo[83902]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13" returned: 0 in 0.622s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:55 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 is being set with open permissions: ugo+rw Apr 13 17:22:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:55 devstack sudo[83907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 Apr 13 17:22:55 devstack sudo[83907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:56 devstack sudo[83907]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13" returned: 0 in 0.591s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.866s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=da499bac-6457-49ca-9f91-e18d9131098f,created_at=2026-04-13T15:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-714639404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da499bac-6457-49ca-9f91-e18d9131098f,host='devstack@QuobyteHD#QuobyteHD',id=2564b966-99c0-43ca-b25b-24048e7b4373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b282c15ab8436b818b81ff2e6ce3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:22:55Z,use_quota=True,user_id='3e89342546e74cc3b0d111388328d672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(519f513e-0083-4d1d-b4b2-e3f25095c56d),volume_type_id=519f513e-0083-4d1d-b4b2-e3f25095c56d)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:22:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Creating volume 2564b966-99c0-43ca-b25b-24048e7b4373 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:22:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:22:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:22:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:22:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:22:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:22:56 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:22:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:56 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-0b64cc27-47f5-4689-9f50-6802e047440d tempest-SnapshotsActionsTest-584482458 None] Create snapshot completed successfully Apr 13 17:22:56 devstack sudo[83910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 1073741824 Apr 13 17:22:56 devstack sudo[83910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:57 devstack sudo[83910]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 1073741824" returned: 0 in 0.649s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:57 devstack sudo[83915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 Apr 13 17:22:57 devstack sudo[83915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Acquiring lock "cinder-774be475-b936-4945-87c9-d88a6c98af13-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-774be475-b936-4945-87c9-d88a6c98af13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Acquiring lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Acquiring lock "cinder-quobyte-774be475-b936-4945-87c9-d88a6c98af13" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-774be475-b936-4945-87c9-d88a6c98af13" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Deleting offline snapshot 774be475-b936-4945-87c9-d88a6c98af13 of volume 1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] snapshot_file for this snap is: volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d33fd3-3572-492a-859e-e87aa8c3bf52]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:57 devstack sudo[83915]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373" returned: 0 in 0.484s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0f007d-6af0-47c4-8e82-77fcaa0cbef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2564b966-99c0-43ca-b25b-24048e7b4373', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02889017-bfec-48f4-917e-be7cfcda8112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:22:57 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Volume volume-2564b966-99c0-43ca-b25b-24048e7b4373 (2564b966-99c0-43ca-b25b-24048e7b4373): created successfully Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02889017-bfec-48f4-917e-be7cfcda8112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:22:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Flow 'volume_create_manager' (16150674-e157-4c6c-969b-27c7ccc2f6e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:22:57 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-76f728fe-00be-4144-aee1-e638129ffdda tempest-GroupSnapshotsTest-776228881 None] Created volume successfully. Apr 13 17:22:57 devstack sudo[83918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 Apr 13 17:22:57 devstack sudo[83918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:58 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-71db6c95-2bd3-47d0-94ab-3a1f18b7976e tempest-GroupSnapshotsTest-776228881 None] Update group completed successfully. Apr 13 17:22:58 devstack sudo[83918]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13" returned: 0 in 0.670s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:22:58 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[931fe20d-c080-450f-8ff0-84799acc0366]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:22:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:58 devstack sudo[83924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:22:58 devstack sudo[83924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:59 devstack sudo[83924]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 0.801s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:22:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:59 devstack sudo[83929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 Apr 13 17:22:59 devstack sudo[83929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:22:59 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-79d6aaa5-351f-4159-af9d-96c0234007cc tempest-GroupSnapshotsTest-776228881 None] Update group completed successfully. Apr 13 17:22:59 devstack sudo[83929]: pam_unix(sudo:session): session closed for user root Apr 13 17:22:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13" returned: 0 in 0.798s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:22:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:22:59 devstack sudo[83938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13 Apr 13 17:22:59 devstack sudo[83938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:00 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-6ce122ae-bde0-474a-8053-58c4074513ec tempest-GroupSnapshotsTest-776228881 None] Update group completed successfully. Apr 13 17:23:00 devstack sudo[83938]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.774be475-b936-4945-87c9-d88a6c98af13" returned: 0 in 0.839s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-774be475-b936-4945-87c9-d88a6c98af13" released by "_delete_snapshot" :: held 3.190s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" released by "delete_snapshot" :: held 3.219s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:00 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Created reservations ['dac5d0c2-697b-4db5-8e53-cb8c055e8171', 'dd102e7a-c661-4564-9a1b-4690d29304a5', '64e7ae0b-0e4d-4b4b-ab69-78cd941b5c7c', '27786261-d166-49b8-a4ed-2e0511e768ab'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:00 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Delete snapshot completed successfully. Apr 13 17:23:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f86b7a85-bbb2-4970-847c-57c7c08b50ea tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-774be475-b936-4945-87c9-d88a6c98af13-delete_snapshot" released by "delete_snapshot" :: held 3.376s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:01 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f6db7efe-4a8c-4865-8ee6-bf37b7de4c39 tempest-GroupSnapshotsTest-776228881 None] Update group completed successfully. Apr 13 17:23:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] Creating offline snapshot 32dc75eb-61e6-4180-aca4-563139ea10bd of volume 1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:23:02 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bba4bb-affc-4107-8048-4936375e31bc]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:02 devstack sudo[83944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:23:02 devstack sudo[83944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:02 devstack sudo[83944]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 0.732s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:02 devstack sudo[83949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd 1G Apr 13 17:23:02 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] GroupSnapshot 00b6e94a-137f-4071-a239-a8515e5f377f: creating. Apr 13 17:23:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Group snapshot 00b6e94a-137f-4071-a239-a8515e5f377f: creating. {{(pid=81998) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 17:23:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:03 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd 1G" returned: 0 in 0.651s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:03 devstack sudo[83954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd Apr 13 17:23:03 devstack sudo[83954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:04 devstack sudo[83954]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd" returned: 0 in 0.648s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:04 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd is being set with open permissions: ugo+rw Apr 13 17:23:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:04 devstack sudo[83960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd Apr 13 17:23:04 devstack sudo[83960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:04 devstack sudo[83960]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd" returned: 0 in 0.614s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.739s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.786s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Creating offline snapshot 0347e43f-9ccb-4406-8f72-5ac141786026 of volume 3e7d5533-25c2-419b-9e04-a443666c8907 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:23:04 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0084345c-dee0-43b4-a5fc-4c6655298005]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:04 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-0cfe6c86-1a10-4f15-8639-a1e857b87892 tempest-SnapshotsActionsTest-584482458 None] Create snapshot completed successfully Apr 13 17:23:04 devstack sudo[83964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 Apr 13 17:23:04 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Acquiring lock "cinder-32dc75eb-61e6-4180-aca4-563139ea10bd-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-32dc75eb-61e6-4180-aca4-563139ea10bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Acquiring lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Acquiring lock "cinder-quobyte-32dc75eb-61e6-4180-aca4-563139ea10bd" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-32dc75eb-61e6-4180-aca4-563139ea10bd" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Deleting offline snapshot 32dc75eb-61e6-4180-aca4-563139ea10bd of volume 1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:23:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] snapshot_file for this snap is: volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:23:05 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a503fd08-634e-4041-8b60-8e5f5c316047]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:05 devstack sudo[83967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd Apr 13 17:23:05 devstack sudo[83967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:05 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907" returned: 0 in 1.150s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:06 devstack sudo[83973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 1G Apr 13 17:23:06 devstack sudo[83973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Flow 'volume_create_manager' (a8feb2a6-33b3-47fc-9531-9a35859d6b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadd4807-4c83-4777-bbac-85108fcebec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadd4807-4c83-4777-bbac-85108fcebec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:23:06Z,deleted=False,deleted_at=None,display_description='',display_name='59b7d791-f521-4fdc-b695-93f8e4ba7151-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dfd1d1-c762-405f-8da0-4b3628900e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a262604ee9413288064924febb0418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:23:06Z,use_quota=True,user_id='e3dcfbaef6c643d0af7f25a4aeeadad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b132377-74fb-461e-855e-0dc54987cb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b132377-74fb-461e-855e-0dc54987cb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e073ab-18c4-46a8-9582-01979252c61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e073ab-18c4-46a8-9582-01979252c61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3dfd1d1-c762-405f-8da0-4b3628900e59', 'volume_name': 'volume-a3dfd1d1-c762-405f-8da0-4b3628900e59', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5c58ac-7158-40b6-bb13-c8594ecf4b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5c58ac-7158-40b6-bb13-c8594ecf4b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6bdfb2b-d4ae-4a5c-98ce-3ff41413c5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:06 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Volume a3dfd1d1-c762-405f-8da0-4b3628900e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3dfd1d1-c762-405f-8da0-4b3628900e59', 'volume_size': 1} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:06 devstack sudo[83967]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd" returned: 0 in 0.789s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d7b662-c3d1-4ad5-b3cb-8102d5d4fb1b]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:06 devstack sudo[83978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:23:06 devstack sudo[83978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:06 devstack sudo[83973]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 1G" returned: 0 in 0.816s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e7d5533-25c2-419b-9e04-a443666c8907 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:06 devstack sudo[83985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e7d5533-25c2-419b-9e04-a443666c8907 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 Apr 13 17:23:06 devstack sudo[83985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:07 devstack sudo[83978]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 0.838s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:07 devstack sudo[83993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd Apr 13 17:23:07 devstack sudo[83993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:07 devstack sudo[83985]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e7d5533-25c2-419b-9e04-a443666c8907 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026" returned: 0 in 0.714s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:07 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:23:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:07 devstack sudo[83999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 Apr 13 17:23:07 devstack sudo[83999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:07 devstack sudo[83993]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd" returned: 0 in 0.725s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:07 devstack sudo[84006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd Apr 13 17:23:07 devstack sudo[84006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:08 devstack sudo[83999]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026" returned: 0 in 0.809s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:08 devstack sudo[84013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.info Apr 13 17:23:08 devstack sudo[84013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:08 devstack sudo[84013]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.info" returned: 0 in 0.447s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:08 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:23:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:08 devstack sudo[84006]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.32dc75eb-61e6-4180-aca4-563139ea10bd" returned: 0 in 0.847s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:08 devstack sudo[84019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.info Apr 13 17:23:08 devstack sudo[84019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-32dc75eb-61e6-4180-aca4-563139ea10bd" released by "_delete_snapshot" :: held 3.287s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" released by "delete_snapshot" :: held 3.304s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:08 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Created reservations ['eab35d64-c92f-4da8-96b2-3ea0651d70db', '89efe230-f07b-41b8-8e3e-51e7ed072895', '9f94eba6-0115-407f-89f2-2bb4e1e40f29', '53af2b64-d982-4301-bf2d-b1470ec8f3cd'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:08 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Delete snapshot completed successfully. Apr 13 17:23:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bdbe5403-761b-490f-8757-d53116abe88b tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-32dc75eb-61e6-4180-aca4-563139ea10bd-delete_snapshot" released by "delete_snapshot" :: held 3.442s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:09 devstack sudo[84019]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.info" returned: 0 in 0.629s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.637s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Creating offline snapshot 604b5a91-e53e-490e-9320-a85201275f63 of volume 2564b966-99c0-43ca-b25b-24048e7b4373 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:23:09 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35217b8-bcc4-49d3-b970-08637a25a2ed]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:09 devstack sudo[84027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 Apr 13 17:23:09 devstack sudo[84027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:10 devstack sudo[84027]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373" returned: 0 in 0.641s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:10 devstack sudo[84038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 1G Apr 13 17:23:10 devstack sudo[84038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:10 devstack sudo[84038]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 1G" returned: 0 in 0.647s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2564b966-99c0-43ca-b25b-24048e7b4373 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:10 devstack sudo[84054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2564b966-99c0-43ca-b25b-24048e7b4373 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 Apr 13 17:23:10 devstack sudo[84054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:11 devstack sudo[84054]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2564b966-99c0-43ca-b25b-24048e7b4373 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63" returned: 0 in 0.460s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:11 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:23:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:11 devstack sudo[84059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 Apr 13 17:23:11 devstack sudo[84059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:11 devstack sudo[84059]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63" returned: 0 in 0.441s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:11 devstack sudo[84064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.info Apr 13 17:23:11 devstack sudo[84064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:12 devstack sudo[84064]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.info" returned: 0 in 0.659s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:12 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:12 devstack sudo[84067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.info Apr 13 17:23:12 devstack sudo[84067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:12 devstack sudo[84067]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.info" returned: 0 in 0.527s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.429s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.576s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:23:06Z,deleted=False,deleted_at=None,display_description='',display_name='59b7d791-f521-4fdc-b695-93f8e4ba7151-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dfd1d1-c762-405f-8da0-4b3628900e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a262604ee9413288064924febb0418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:23:06Z,use_quota=True,user_id='e3dcfbaef6c643d0af7f25a4aeeadad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Creating volume a3dfd1d1-c762-405f-8da0-4b3628900e59 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:23:12 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:23:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:12 devstack sudo[84070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59 1073741824 Apr 13 17:23:12 devstack sudo[84070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:13 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-8ec144d3-388a-4c90-a81c-1a739dbddc02 tempest-GroupSnapshotsTest-776228881 None] group_snapshot 00b6e94a-137f-4071-a239-a8515e5f377f: created successfully Apr 13 17:23:13 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] group_snapshot 00b6e94a-137f-4071-a239-a8515e5f377f: deleting Apr 13 17:23:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] group_snapshot 00b6e94a-137f-4071-a239-a8515e5f377f: deleting {{(pid=81998) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 17:23:13 devstack sudo[84070]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59 1073741824" returned: 0 in 0.639s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-3e7d5533-25c2-419b-9e04-a443666c8907" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-3e7d5533-25c2-419b-9e04-a443666c8907" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-0347e43f-9ccb-4406-8f72-5ac141786026" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-0347e43f-9ccb-4406-8f72-5ac141786026" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Deleting offline snapshot 0347e43f-9ccb-4406-8f72-5ac141786026 of volume 3e7d5533-25c2-419b-9e04-a443666c8907 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:23:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] snapshot_file for this snap is: volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:23:13 devstack sudo[84077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59 Apr 13 17:23:13 devstack sudo[84077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:13 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6282dcc1-7b0c-4497-8b2d-2f12ec258e1b]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:13 devstack sudo[84079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 Apr 13 17:23:13 devstack sudo[84079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:14 devstack sudo[84077]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59" returned: 0 in 0.690s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.234s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6bdfb2b-d4ae-4a5c-98ce-3ff41413c5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3dfd1d1-c762-405f-8da0-4b3628900e59', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86adb0d9-d7a7-4fef-b9d5-0b900000fa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] Creating offline snapshot e95a5812-64fa-4804-ad89-b65424e57229 of volume 1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:23:14 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Volume volume-a3dfd1d1-c762-405f-8da0-4b3628900e59 (a3dfd1d1-c762-405f-8da0-4b3628900e59): created successfully Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86adb0d9-d7a7-4fef-b9d5-0b900000fa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Flow 'volume_create_manager' (a8feb2a6-33b3-47fc-9531-9a35859d6b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63c81fa-670c-4898-a9ac-b3993fb22c7c]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:14 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-2796dd1b-f55c-40e3-a30b-bacc03cb28ff tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Created volume successfully. Apr 13 17:23:14 devstack sudo[84098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:23:14 devstack sudo[84098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:14 devstack sudo[84079]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026" returned: 0 in 1.001s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e7d5533-25c2-419b-9e04-a443666c8907(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e066557-7962-4653-b4f8-236beab7a050]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:14 devstack sudo[84103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 Apr 13 17:23:14 devstack sudo[84103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:15 devstack sudo[84098]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 0.723s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:15 devstack sudo[84108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 1G Apr 13 17:23:15 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:15 devstack sudo[84103]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907" returned: 0 in 0.701s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:15 devstack sudo[84114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 Apr 13 17:23:15 devstack sudo[84114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-0ba6caae-94ce-431f-a8d4-81e0ef2791f6 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:16 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 1G" returned: 0 in 1.222s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:16 devstack sudo[84134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 Apr 13 17:23:16 devstack sudo[84134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:16 devstack sudo[84114]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026" returned: 0 in 1.027s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:16 devstack sudo[84139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026 Apr 13 17:23:16 devstack sudo[84139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:16 devstack sudo[84134]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229" returned: 0 in 0.556s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:16 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 is being set with open permissions: ugo+rw Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:16 devstack sudo[84158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 Apr 13 17:23:16 devstack sudo[84158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:16 devstack sudo[84139]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907.0347e43f-9ccb-4406-8f72-5ac141786026" returned: 0 in 0.605s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-0347e43f-9ccb-4406-8f72-5ac141786026" released by "_delete_snapshot" :: held 3.401s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-3e7d5533-25c2-419b-9e04-a443666c8907" released by "delete_snapshot" :: held 3.425s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-2564b966-99c0-43ca-b25b-24048e7b4373" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-2564b966-99c0-43ca-b25b-24048e7b4373" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-604b5a91-e53e-490e-9320-a85201275f63" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-604b5a91-e53e-490e-9320-a85201275f63" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Deleting offline snapshot 604b5a91-e53e-490e-9320-a85201275f63 of volume 2564b966-99c0-43ca-b25b-24048e7b4373 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:23:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] snapshot_file for this snap is: volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1e8d18-55be-4312-b453-963944dc29ce]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:17 devstack sudo[84160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 Apr 13 17:23:17 devstack sudo[84160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:17 devstack sudo[84158]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229" returned: 0 in 0.548s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.152s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-0ba6caae-94ce-431f-a8d4-81e0ef2791f6 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.459s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d045e43-534a-4491-8f6c-2704cd798b52]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-0ba6caae-94ce-431f-a8d4-81e0ef2791f6 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:17 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-fc250b79-739d-40fe-93db-9531a7f28805 tempest-SnapshotsActionsTest-584482458 None] Create snapshot completed successfully Apr 13 17:23:17 devstack sudo[84163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59 Apr 13 17:23:17 devstack sudo[84163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:17 devstack sudo[84160]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63" returned: 0 in 0.639s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2564b966-99c0-43ca-b25b-24048e7b4373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefe9999-da76-4e66-a73c-2a4217f38e2d]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:17 devstack sudo[84168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 Apr 13 17:23:17 devstack sudo[84168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:17 devstack sudo[84163]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-0ba6caae-94ce-431f-a8d4-81e0ef2791f6 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59" returned: 0 in 0.602s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-0ba6caae-94ce-431f-a8d4-81e0ef2791f6 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.620s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-0ba6caae-94ce-431f-a8d4-81e0ef2791f6 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6', 'name': 'volume-a3dfd1d1-c762-405f-8da0-4b3628900e59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '384efb93-89e8-48a9-abf9-3a19af95b5b8', 'enforce_multipath': True} {{(pid=81998) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 17:23:18 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-657e1faa-c9a3-4b5e-ab35-17957e7850bf req-0ba6caae-94ce-431f-a8d4-81e0ef2791f6 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] attachment_update completed successfully. Apr 13 17:23:18 devstack sudo[84168]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373" returned: 0 in 0.833s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:18 devstack sudo[84201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 Apr 13 17:23:18 devstack sudo[84201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Acquiring lock "cinder-e95a5812-64fa-4804-ad89-b65424e57229-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-e95a5812-64fa-4804-ad89-b65424e57229-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Acquiring lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Acquiring lock "cinder-quobyte-e95a5812-64fa-4804-ad89-b65424e57229" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-e95a5812-64fa-4804-ad89-b65424e57229" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Deleting offline snapshot e95a5812-64fa-4804-ad89-b65424e57229 of volume 1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] snapshot_file for this snap is: volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[af54dae8-e28e-4b64-9842-6957de71d3e6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:19 devstack sudo[84205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 Apr 13 17:23:19 devstack sudo[84205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:19 devstack sudo[84205]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229" returned: 0 in 0.833s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:19 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[553d0d5c-baac-487e-861e-e1aaa114bd67]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:19 devstack sudo[84201]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63" returned: 0 in 1.143s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:19 devstack sudo[84216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63 Apr 13 17:23:19 devstack sudo[84216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:19 devstack sudo[84215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:23:19 devstack sudo[84215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:20 devstack sudo[84215]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 0.812s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:20 devstack sudo[84216]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373.604b5a91-e53e-490e-9320-a85201275f63" returned: 0 in 0.778s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:20 devstack sudo[84270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 Apr 13 17:23:20 devstack sudo[84270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:20 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-604b5a91-e53e-490e-9320-a85201275f63" released by "_delete_snapshot" :: held 3.489s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:20 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-2564b966-99c0-43ca-b25b-24048e7b4373" released by "delete_snapshot" :: held 3.506s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:20 devstack cinder-volume[81998]: WARNING cinder.quota [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1519008688 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1519008688, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:23:20 devstack cinder-volume[81998]: WARNING cinder.quota [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1519008688 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1519008688, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:23:20 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Created reservations ['21d2d27e-b75b-484b-b7a5-fffcfd8debd1', '9c0b48f4-f090-4bc2-9114-34bb43f65a99', '42eb4180-8a90-4932-b7bf-16da97f8ad29', '2546e913-ad8a-4142-b0d7-d38b9d5e50f6'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:20 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] Created reservations ['667b3e25-84db-4700-aef9-9c673b3681a5', '2aba3bee-beb1-4020-b9e7-1c2a1bc9f7f4', '9074206d-0867-4472-8e4c-32aabf524bdb', '4c22e112-602d-4650-9fe3-6ea1eeb832e0'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:20 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-741c7acc-18a6-4170-a8d8-ce8873256b9d tempest-GroupSnapshotsTest-776228881 None] group_snapshot 00b6e94a-137f-4071-a239-a8515e5f377f: deleted successfully Apr 13 17:23:20 devstack sudo[84270]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229" returned: 0 in 0.520s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:20 devstack sudo[84298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229 Apr 13 17:23:20 devstack sudo[84298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-2564b966-99c0-43ca-b25b-24048e7b4373" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-2564b966-99c0-43ca-b25b-24048e7b4373" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:21 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8f62ff-090b-4e84-91ff-4a070efd2b93]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:21 devstack sudo[84306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 Apr 13 17:23:21 devstack sudo[84306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:21 devstack sudo[84298]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.e95a5812-64fa-4804-ad89-b65424e57229" returned: 0 in 0.575s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-e95a5812-64fa-4804-ad89-b65424e57229" released by "_delete_snapshot" :: held 2.844s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" released by "delete_snapshot" :: held 2.898s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:21 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Created reservations ['807fb597-77c8-4f5e-a039-95a7a45582b3', '14b5e1a4-a359-441c-a57d-3a5b9cbc12c5', '873928c7-af41-46cb-a6db-bfc1749fe92d', '09116249-c0af-413f-b358-a3fc034285d2'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:21 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Delete snapshot completed successfully. Apr 13 17:23:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69bf9f9c-0628-46c6-bb92-bd9819bac809 tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-e95a5812-64fa-4804-ad89-b65424e57229-delete_snapshot" released by "delete_snapshot" :: held 3.003s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:22 devstack sudo[84306]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373" returned: 0 in 0.798s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:22 devstack sudo[84351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373 Apr 13 17:23:22 devstack sudo[84351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] Creating offline snapshot b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 of volume 1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:23:22 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8af8213-95b5-4814-834d-9578b7487fbc]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:22 devstack sudo[84353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:23:22 devstack sudo[84353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:23 devstack sudo[84351]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-2564b966-99c0-43ca-b25b-24048e7b4373" returned: 0 in 0.902s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-2564b966-99c0-43ca-b25b-24048e7b4373" released by "delete_volume" :: held 1.787s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-3e7d5533-25c2-419b-9e04-a443666c8907" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-3e7d5533-25c2-419b-9e04-a443666c8907" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:23 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8034e03-7774-4a98-9681-408cd0524394]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:23 devstack sudo[84583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 Apr 13 17:23:23 devstack sudo[84583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:23 devstack sudo[84353]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 1.050s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:23 devstack sudo[84691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 1G Apr 13 17:23:23 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:24 devstack sudo[84583]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907" returned: 0 in 1.344s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:24 devstack sudo[84709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907 Apr 13 17:23:24 devstack sudo[84709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:24 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 1G" returned: 0 in 1.269s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:24 devstack sudo[84713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 Apr 13 17:23:24 devstack sudo[84713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:25 devstack sudo[84709]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3e7d5533-25c2-419b-9e04-a443666c8907" returned: 0 in 0.816s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-3e7d5533-25c2-419b-9e04-a443666c8907" released by "delete_volume" :: held 2.257s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:25 devstack sudo[84713]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5" returned: 0 in 0.689s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:25 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 is being set with open permissions: ugo+rw Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:25 devstack sudo[84721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 Apr 13 17:23:25 devstack sudo[84721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Created reservations ['85c2bc44-b9e1-432f-bfc5-4d69dfdb4fc2'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:25 devstack cinder-volume[81998]: WARNING cinder.quota [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1519008688 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1519008688, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Created reservations ['115d9505-fe95-48d9-82b8-2bf5905fced0', 'fee0723f-44b0-4ef6-a584-43a4253868bb', '776464b1-65f9-41a6-81b2-448982b9fb8f', '3af7f704-a45d-4548-a476-a7e8d97ad94c'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Created reservations ['80e54993-890c-4cfd-90e2-9aa335a4cdd3', 'db343176-d1de-425f-a1be-4b6a9636a4da', '76057caf-8aee-4dbf-a086-73fd7b51be95', '2cc72505-875c-4529-b309-4a77c84ee105'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:25 devstack sudo[84723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:23:25 devstack sudo[84723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:26 devstack sudo[84721]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5" returned: 0 in 0.815s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.930s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:26 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-87d6d19a-3d74-425e-8240-5da0b257476f tempest-SnapshotsActionsTest-584482458 None] Create snapshot completed successfully Apr 13 17:23:26 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-3c79b5ee-944f-4981-aa1c-b2406fe0a5c8 tempest-GroupSnapshotsTest-776228881 None] Group tempest-GroupSnapshotsTest-Group-843545071: creating Apr 13 17:23:26 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-3c79b5ee-944f-4981-aa1c-b2406fe0a5c8 tempest-GroupSnapshotsTest-776228881 None] Group tempest-GroupSnapshotsTest-Group-843545071: created successfully Apr 13 17:23:26 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-3c79b5ee-944f-4981-aa1c-b2406fe0a5c8 tempest-GroupSnapshotsTest-776228881 None] Create group completed successfully. Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Acquiring lock "cinder-b114d4b5-29c1-44c2-82ca-0b2ff8d429f5-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-b114d4b5-29c1-44c2-82ca-0b2ff8d429f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Acquiring lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:26 devstack sudo[84723]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 1.241s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:23:26 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f38385ec-5604-4626-ab72-ca58a90a24a3 tempest-GroupSnapshotsTest-776228881 None] Delete group completed successfully. Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Acquiring lock "cinder-quobyte-b114d4b5-29c1-44c2-82ca-0b2ff8d429f5" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-b114d4b5-29c1-44c2-82ca-0b2ff8d429f5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Deleting offline snapshot b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 of volume 1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] snapshot_file for this snap is: volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9ef6ad-55f6-490e-a06e-0d6f7a2a811f]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:27 devstack sudo[84728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 Apr 13 17:23:27 devstack sudo[84728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:28 devstack sudo[84728]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5" returned: 0 in 1.219s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f244a7-1b99-4919-b200-ec5faf87bed1]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Flow 'volume_create_manager' (4eaa6f09-d883-44ee-a15a-b9dcc3dc988e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba942857-34df-4392-a23e-915180b3f89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:28 devstack sudo[84733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:23:28 devstack sudo[84733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba942857-34df-4392-a23e-915180b3f89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1619386086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9cb7f289-9f65-41cd-9fdf-97835dda01b4,host='devstack@QuobyteHD#QuobyteHD',id=043167ad-cb31-4853-968a-6f917f0739a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b282c15ab8436b818b81ff2e6ce3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:23:28Z,use_quota=True,user_id='3e89342546e74cc3b0d111388328d672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c664bd04-d35e-42b5-a2e7-69e9dd67901d),volume_type_id=c664bd04-d35e-42b5-a2e7-69e9dd67901d)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951f8085-e8d9-432e-8ca3-007386220267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951f8085-e8d9-432e-8ca3-007386220267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab156f4-8daa-4910-986d-30d15bee0d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab156f4-8daa-4910-986d-30d15bee0d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '043167ad-cb31-4853-968a-6f917f0739a1', 'volume_name': 'volume-043167ad-cb31-4853-968a-6f917f0739a1', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861f4f02-1561-48c8-ad97-d2163cb85243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861f4f02-1561-48c8-ad97-d2163cb85243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f474a9b0-2c75-4aac-b0a6-bb3759947e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:28 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Volume 043167ad-cb31-4853-968a-6f917f0739a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-043167ad-cb31-4853-968a-6f917f0739a1', 'volume_size': 1} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9cb7f289-9f65-41cd-9fdf-97835dda01b4,created_at=2026-04-13T15:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1619386086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9cb7f289-9f65-41cd-9fdf-97835dda01b4,host='devstack@QuobyteHD#QuobyteHD',id=043167ad-cb31-4853-968a-6f917f0739a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b282c15ab8436b818b81ff2e6ce3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:23:28Z,use_quota=True,user_id='3e89342546e74cc3b0d111388328d672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c664bd04-d35e-42b5-a2e7-69e9dd67901d),volume_type_id=c664bd04-d35e-42b5-a2e7-69e9dd67901d)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Creating volume 043167ad-cb31-4853-968a-6f917f0739a1 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:23:28 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:23:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:28 devstack sudo[84735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 1073741824 Apr 13 17:23:28 devstack sudo[84735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:29 devstack sudo[84733]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 0.912s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:29 devstack sudo[84765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 Apr 13 17:23:29 devstack sudo[84765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:29 devstack sudo[84735]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 1073741824" returned: 0 in 0.964s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:29 devstack sudo[84768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 Apr 13 17:23:29 devstack sudo[84768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:29 devstack sudo[84765]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5" returned: 0 in 0.749s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:29 devstack sudo[84775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5 Apr 13 17:23:29 devstack sudo[84775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:29 devstack sudo[84768]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1" returned: 0 in 0.523s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f474a9b0-2c75-4aac-b0a6-bb3759947e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-043167ad-cb31-4853-968a-6f917f0739a1', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba953c5-41c3-475f-81bc-ce9891cd9718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:29 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Volume volume-043167ad-cb31-4853-968a-6f917f0739a1 (043167ad-cb31-4853-968a-6f917f0739a1): created successfully Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba953c5-41c3-475f-81bc-ce9891cd9718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Flow 'volume_create_manager' (4eaa6f09-d883-44ee-a15a-b9dcc3dc988e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:23:29 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-5363fd71-0769-4145-849f-12c1a60aa456 tempest-GroupSnapshotsTest-776228881 None] Created volume successfully. Apr 13 17:23:30 devstack sudo[84775]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.b114d4b5-29c1-44c2-82ca-0b2ff8d429f5" returned: 0 in 0.451s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-b114d4b5-29c1-44c2-82ca-0b2ff8d429f5" released by "_delete_snapshot" :: held 3.476s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" released by "delete_snapshot" :: held 3.498s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:30 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Created reservations ['b81ab0f0-9c74-4f6a-ac01-fd37d8c59c49', 'a621f005-68a2-4335-86bd-8a35af8df155', '9f12308e-8b02-40b7-b8e1-43db41191849', 'fd8d940a-2122-4c72-9aa1-5ce949da40c9'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:30 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Delete snapshot completed successfully. Apr 13 17:23:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e1567975-3b4c-4210-89f5-b5c7ae692f72 tempest-SnapshotsActionsTest-1702833773 None] Lock "cinder-b114d4b5-29c1-44c2-82ca-0b2ff8d429f5-delete_snapshot" released by "delete_snapshot" :: held 3.659s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:30 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] GroupSnapshot 91bd9ef7-7b9b-48db-b942-2766113957dc: creating. Apr 13 17:23:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] Group snapshot 91bd9ef7-7b9b-48db-b942-2766113957dc: creating. {{(pid=81998) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 17:23:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] Creating offline snapshot c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 of volume 043167ad-cb31-4853-968a-6f917f0739a1 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:23:30 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c52b58-72dc-41fd-aa70-f0c3ce052ed5]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:30 devstack sudo[84818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 Apr 13 17:23:30 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:31 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1" returned: 0 in 0.534s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:31 devstack sudo[84823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 1G Apr 13 17:23:31 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "cinder-a7c357d7-1aca-4cc5-8569-384f41b2b2b3-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Lock "cinder-a7c357d7-1aca-4cc5-8569-384f41b2b2b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "cinder-quobyte-a7c357d7-1aca-4cc5-8569-384f41b2b2b3" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Lock "cinder-quobyte-a7c357d7-1aca-4cc5-8569-384f41b2b2b3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Deleting offline snapshot a7c357d7-1aca-4cc5-8569-384f41b2b2b3 of volume 1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] snapshot_file for this snap is: volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[550f0965-f86a-4cb9-8cec-0eb49d0c7d7e]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:31 devstack sudo[84826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:23:31 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:31 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 1G" returned: 0 in 0.643s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043167ad-cb31-4853-968a-6f917f0739a1 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:31 devstack sudo[84831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043167ad-cb31-4853-968a-6f917f0739a1 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 Apr 13 17:23:31 devstack sudo[84831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:32 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 0.587s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e78ca13-cb89-4920-a936-006e1810d4dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fdfbdd-3417-400e-8d04-dce551f095f6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:32 devstack sudo[84844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc Apr 13 17:23:32 devstack sudo[84844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:32 devstack sudo[84831]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043167ad-cb31-4853-968a-6f917f0739a1 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0" returned: 0 in 0.731s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:32 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:23:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:32 devstack sudo[84874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 Apr 13 17:23:32 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:32 devstack sudo[84844]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc" returned: 0 in 0.759s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:32 devstack sudo[84879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:23:32 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:33 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0" returned: 0 in 0.547s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:33 devstack sudo[84882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.info Apr 13 17:23:33 devstack sudo[84882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:33 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 0.572s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:33 devstack sudo[84887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3 Apr 13 17:23:33 devstack sudo[84887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:33 devstack cinder-volume[81998]: DEBUG oslo_service.periodic_task [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:23:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:23:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:23:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:33 devstack sudo[84912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:23:33 devstack sudo[84912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:34 devstack sudo[84912]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.846s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:23:34 devstack sudo[84882]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.info" returned: 0 in 1.522s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:34 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:23:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:34 devstack sudo[84937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.info Apr 13 17:23:34 devstack sudo[84937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:35 devstack sudo[84887]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc.a7c357d7-1aca-4cc5-8569-384f41b2b2b3" returned: 0 in 1.643s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Lock "cinder-quobyte-a7c357d7-1aca-4cc5-8569-384f41b2b2b3" released by "_delete_snapshot" :: held 3.666s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" released by "delete_snapshot" :: held 3.688s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Created reservations ['e68789df-c6ef-45d9-a8fe-aec3772b9a62', 'a38e7055-319d-40a7-ac10-d9f531c59cd9', '281a2fc8-fdcb-4ed6-8606-aa4aed9d93ba', '601cf726-8c8f-484b-a143-614dae89fe2f'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:35 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Delete snapshot completed successfully. Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f958f9b-89e6-449e-b5dd-10118da012d3 tempest-SnapshotsActionsTest-584482458 None] Lock "cinder-a7c357d7-1aca-4cc5-8569-384f41b2b2b3-delete_snapshot" released by "delete_snapshot" :: held 3.781s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:35 devstack sudo[84937]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.info" returned: 0 in 0.704s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.741s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:35 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b62b9250-951e-49f2-abdf-3ff9f49681b7 tempest-GroupSnapshotsTest-776228881 None] group_snapshot 91bd9ef7-7b9b-48db-b942-2766113957dc: created successfully Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "cinder-1e78ca13-cb89-4920-a936-006e1810d4dc-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Lock "cinder-1e78ca13-cb89-4920-a936-006e1810d4dc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9475b212-d48c-49c8-af4f-02e8ffb13452]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:35 devstack sudo[84954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc Apr 13 17:23:35 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:36 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] group_snapshot 91bd9ef7-7b9b-48db-b942-2766113957dc: deleting Apr 13 17:23:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] group_snapshot 91bd9ef7-7b9b-48db-b942-2766113957dc: deleting {{(pid=81998) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 17:23:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-043167ad-cb31-4853-968a-6f917f0739a1" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-043167ad-cb31-4853-968a-6f917f0739a1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-c06b33b1-7d35-48d9-9dd5-dbd69b2476f0" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-c06b33b1-7d35-48d9-9dd5-dbd69b2476f0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Deleting offline snapshot c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 of volume 043167ad-cb31-4853-968a-6f917f0739a1 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:23:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] snapshot_file for this snap is: volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:23:36 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d71e5de-505b-400d-a565-c6eae205e4f2]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:36 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc" returned: 0 in 0.643s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:36 devstack sudo[84960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc Apr 13 17:23:36 devstack sudo[84960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:36 devstack sudo[84958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 Apr 13 17:23:36 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:37 devstack sudo[84960]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e78ca13-cb89-4920-a936-006e1810d4dc" returned: 0 in 0.680s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Lock "cinder-quobyte-1e78ca13-cb89-4920-a936-006e1810d4dc" released by "delete_volume" :: held 1.449s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Created reservations ['a79d6968-4c3f-44d0-8c8a-b2a208ea43d3', '0b67ab48-967a-4c2a-ab99-2e54a650f9c2', 'e23f947c-586f-42c8-abde-d9b160024e21', '720b4945-bf50-4518-b6cd-b5288b086696'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:37 devstack sudo[84969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:23:37 devstack sudo[84969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:37 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0" returned: 0 in 1.064s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043167ad-cb31-4853-968a-6f917f0739a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3bb3b8-8f8e-4eae-934d-6439734b1a9c]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:23:37 devstack sudo[84971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 Apr 13 17:23:37 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Flow 'volume_create_manager' (9ea2d07d-18a6-452e-9745-e89ae89b0408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ef113b-3799-4882-a515-aec6a9f5bf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ef113b-3799-4882-a515-aec6a9f5bf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-343600791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e590a1-8d43-4a4a-9b5f-6c4f24260c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827179be3d144c9b8f2d23a82b4eb531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:23:38Z,use_quota=True,user_id='2b7709910ba940a2b378b04359a960e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6473646e-1d38-4f5e-ae33-6d94de1761f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6473646e-1d38-4f5e-ae33-6d94de1761f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73541061-e699-4fb6-a2d0-3bbbec4b114c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73541061-e699-4fb6-a2d0-3bbbec4b114c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e590a1-8d43-4a4a-9b5f-6c4f24260c77', 'volume_name': 'volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50778c4b-0e7e-421f-9d3f-5b4be3fca31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50778c4b-0e7e-421f-9d3f-5b4be3fca31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101762d0-b73e-467c-b3bc-cfd491043ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:37 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Volume 64e590a1-8d43-4a4a-9b5f-6c4f24260c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77', 'volume_size': 1} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-343600791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e590a1-8d43-4a4a-9b5f-6c4f24260c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827179be3d144c9b8f2d23a82b4eb531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:23:38Z,use_quota=True,user_id='2b7709910ba940a2b378b04359a960e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Creating volume 64e590a1-8d43-4a4a-9b5f-6c4f24260c77 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:23:37 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:23:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:37 devstack sudo[84974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77 1073741824 Apr 13 17:23:37 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:38 devstack sudo[84969]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.853s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:38 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:23:38 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Deleted volume successfully. Apr 13 17:23:38 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-219e78b1-76c7-4ea8-939e-52b43b7eab0e tempest-SnapshotsActionsTest-584482458 None] Lock "cinder-1e78ca13-cb89-4920-a936-006e1810d4dc-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:38 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1" returned: 0 in 1.050s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:38 devstack sudo[84983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 Apr 13 17:23:38 devstack sudo[84983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:38 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77 1073741824" returned: 0 in 1.039s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:38 devstack sudo[84985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77 Apr 13 17:23:38 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:39 devstack sudo[84983]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0" returned: 0 in 1.052s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:39 devstack sudo[85017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0 Apr 13 17:23:39 devstack sudo[85017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:40 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77" returned: 0 in 1.249s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:40 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] <== create_volume: return (2317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:23:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.320s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:40 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101762d0-b73e-467c-b3bc-cfd491043ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:40 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d045d5-cbf2-4821-a33e-59ada2356eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:40 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Volume volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77 (64e590a1-8d43-4a4a-9b5f-6c4f24260c77): created successfully Apr 13 17:23:40 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d045d5-cbf2-4821-a33e-59ada2356eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:40 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Flow 'volume_create_manager' (9ea2d07d-18a6-452e-9745-e89ae89b0408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:23:40 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-80eaccf0-1d4d-4172-91ec-2924fd1bab78 tempest-ServerRescueNegativeTestJSON-1353181555 None] Created volume successfully. Apr 13 17:23:40 devstack sudo[85017]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1.c06b33b1-7d35-48d9-9dd5-dbd69b2476f0" returned: 0 in 1.237s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:40 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-c06b33b1-7d35-48d9-9dd5-dbd69b2476f0" released by "_delete_snapshot" :: held 4.597s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:40 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-043167ad-cb31-4853-968a-6f917f0739a1" released by "delete_snapshot" :: held 4.623s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:41 devstack cinder-volume[81998]: WARNING cinder.quota [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-621531883 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-621531883, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:23:41 devstack cinder-volume[81998]: WARNING cinder.quota [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-621531883 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-621531883, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:23:41 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] Created reservations ['c61051f2-4a6d-4083-b2e5-71fa2bb8bcb6', 'bdefbe69-a9d2-4ba2-bfdc-3ed11a1fa7a5', 'ad78fcc4-a114-496f-b2be-e7e4bc1937d0', '85871ccc-5ee0-4106-9207-6862ec4c93db'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:41 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-9fae4504-720b-467e-a20d-4dde0738b776 tempest-GroupSnapshotsTest-776228881 None] group_snapshot 91bd9ef7-7b9b-48db-b942-2766113957dc: deleted successfully Apr 13 17:23:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "cinder-quobyte-043167ad-cb31-4853-968a-6f917f0739a1" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-043167ad-cb31-4853-968a-6f917f0739a1" acquired by "delete_volume" :: waited 0.026s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:42 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1010d9a9-cf87-4b98-9d24-4833a96db1c2]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:42 devstack sudo[85054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 Apr 13 17:23:42 devstack sudo[85054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:43 devstack sudo[85054]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1" returned: 0 in 1.367s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:43 devstack sudo[85060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1 Apr 13 17:23:43 devstack sudo[85060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:44 devstack sudo[85060]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-043167ad-cb31-4853-968a-6f917f0739a1" returned: 0 in 0.799s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Lock "cinder-quobyte-043167ad-cb31-4853-968a-6f917f0739a1" released by "delete_volume" :: held 2.285s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:44 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:UPDATE=140,cinder:SELECT=155,cinder:INSERT=50,cinder:DELETE=7 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:23:44 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=144,cinder:INSERT=23,cinder:UPDATE=149,cinder:DELETE=6 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:23:44 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Created reservations ['ff809e59-be61-40c6-bd02-6ce2c6bf5d1d'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:44 devstack cinder-volume[81998]: WARNING cinder.quota [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-621531883 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-621531883, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:23:44 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Created reservations ['c76077ac-dbb6-4a9f-9a6a-ada2c178c3e5', '18200d7f-e8b1-4bc0-928c-81a6e5a6f71e', '9194eea7-19fd-4673-ac34-cc0718e63bcd', 'ae97d589-28b9-44e4-a7c7-255a9411f6bb'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:23:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:23:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:44 devstack sudo[85074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:23:44 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:45 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.748s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:45 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:23:45 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-5db79ba1-6e85-46b8-98d4-a7a451910569 tempest-GroupSnapshotsTest-776228881 None] Delete group completed successfully. Apr 13 17:23:50 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-fd28ef0e-ac37-4698-8016-c309003fbfbf tempest-GroupsTest-1491399216 None] Group tempest-Group1-948999181: creating Apr 13 17:23:50 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-fd28ef0e-ac37-4698-8016-c309003fbfbf tempest-GroupsTest-1491399216 None] Group tempest-Group1-948999181: created successfully Apr 13 17:23:50 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-fd28ef0e-ac37-4698-8016-c309003fbfbf tempest-GroupsTest-1491399216 None] Create group completed successfully. Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Flow 'volume_create_manager' (825ad1b5-f464-4dc4-a18f-6791a58ae587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75e446d-afd9-4ff5-8c91-6f331ed0d926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75e446d-afd9-4ff5-8c91-6f331ed0d926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1228120886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0eabbb-97e5-4727-80ea-0a35778093fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab3ce7986d74d3b8572b3af30ff27fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:23:51Z,use_quota=True,user_id='4c85af781234412ea7a8707977b81f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a7ae5b-91c8-4b31-8967-ae6ced56652f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a7ae5b-91c8-4b31-8967-ae6ced56652f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b444214-9b93-4287-85ee-ad2e018fac91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b444214-9b93-4287-85ee-ad2e018fac91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0eabbb-97e5-4727-80ea-0a35778093fc', 'volume_name': 'volume-5d0eabbb-97e5-4727-80ea-0a35778093fc', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f541b85-5fbd-4d14-b905-3bfde936bdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f541b85-5fbd-4d14-b905-3bfde936bdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b6921b-cb56-4510-9884-d66accdb8d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:51 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Volume 5d0eabbb-97e5-4727-80ea-0a35778093fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0eabbb-97e5-4727-80ea-0a35778093fc', 'volume_size': 1} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1228120886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0eabbb-97e5-4727-80ea-0a35778093fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab3ce7986d74d3b8572b3af30ff27fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:23:51Z,use_quota=True,user_id='4c85af781234412ea7a8707977b81f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Creating volume 5d0eabbb-97e5-4727-80ea-0a35778093fc {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:23:51 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5d0eabbb-97e5-4727-80ea-0a35778093fc 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:51 devstack sudo[85210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5d0eabbb-97e5-4727-80ea-0a35778093fc 1073741824 Apr 13 17:23:51 devstack sudo[85210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:51 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-9fe5e724-c151-4b56-b577-64486665ce54 tempest-GroupsTest-1491399216 None] Group tempest-Group2-1483594591: creating Apr 13 17:23:51 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-9fe5e724-c151-4b56-b577-64486665ce54 tempest-GroupsTest-1491399216 None] Group tempest-Group2-1483594591: created successfully Apr 13 17:23:51 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-9fe5e724-c151-4b56-b577-64486665ce54 tempest-GroupsTest-1491399216 None] Create group completed successfully. Apr 13 17:23:51 devstack sudo[85210]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5d0eabbb-97e5-4727-80ea-0a35778093fc 1073741824" returned: 0 in 0.634s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5d0eabbb-97e5-4727-80ea-0a35778093fc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:51 devstack sudo[85215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5d0eabbb-97e5-4727-80ea-0a35778093fc Apr 13 17:23:51 devstack sudo[85215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:52 devstack sudo[85215]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5d0eabbb-97e5-4727-80ea-0a35778093fc" returned: 0 in 0.528s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:23:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b6921b-cb56-4510-9884-d66accdb8d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0eabbb-97e5-4727-80ea-0a35778093fc', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2e8c35-4005-4583-b0f8-7d9c30b702b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:52 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Volume volume-5d0eabbb-97e5-4727-80ea-0a35778093fc (5d0eabbb-97e5-4727-80ea-0a35778093fc): created successfully Apr 13 17:23:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2e8c35-4005-4583-b0f8-7d9c30b702b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Flow 'volume_create_manager' (825ad1b5-f464-4dc4-a18f-6791a58ae587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:23:52 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-35b0776e-0d53-427c-ad3e-c356c96a6ee0 tempest-VolumesServicesTestJSON-1272469790 None] Created volume successfully. Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Flow 'volume_create_manager' (55228f15-96d4-48af-8e55-271fdbd0c2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94016edf-332f-4f84-a86d-4a51db180f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94016edf-332f-4f84-a86d-4a51db180f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1402920906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91473931-562b-4950-9b77-aec710366c9e,host='devstack@QuobyteHD#QuobyteHD',id=c0beefdf-ceb8-4507-9e13-e1849b01818a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b045d53eb86d4f52a844a169bf14c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:23:53Z,use_quota=True,user_id='cfa6707190924d68ae716603e61c44bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfae4780-483b-4e0b-9ae1-403beaec41ff),volume_type_id=cfae4780-483b-4e0b-9ae1-403beaec41ff)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e22048-5ecd-4976-9aaf-583c53eb86fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e22048-5ecd-4976-9aaf-583c53eb86fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40885b45-8a7e-45b0-8b84-2e9e7cb93b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40885b45-8a7e-45b0-8b84-2e9e7cb93b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0beefdf-ceb8-4507-9e13-e1849b01818a', 'volume_name': 'volume-c0beefdf-ceb8-4507-9e13-e1849b01818a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85c0cdf-d375-47cc-88e7-7ec5be5ceb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85c0cdf-d375-47cc-88e7-7ec5be5ceb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e253c136-b7ad-44c8-bf15-126c8d3a7a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:53 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Volume c0beefdf-ceb8-4507-9e13-e1849b01818a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0beefdf-ceb8-4507-9e13-e1849b01818a', 'volume_size': 1} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91473931-562b-4950-9b77-aec710366c9e,created_at=2026-04-13T15:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1402920906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91473931-562b-4950-9b77-aec710366c9e,host='devstack@QuobyteHD#QuobyteHD',id=c0beefdf-ceb8-4507-9e13-e1849b01818a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b045d53eb86d4f52a844a169bf14c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:23:53Z,use_quota=True,user_id='cfa6707190924d68ae716603e61c44bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfae4780-483b-4e0b-9ae1-403beaec41ff),volume_type_id=cfae4780-483b-4e0b-9ae1-403beaec41ff)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Creating volume c0beefdf-ceb8-4507-9e13-e1849b01818a {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:23:53 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c0beefdf-ceb8-4507-9e13-e1849b01818a 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:53 devstack sudo[85221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c0beefdf-ceb8-4507-9e13-e1849b01818a 1073741824 Apr 13 17:23:53 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Acquiring lock "cinder-5d0eabbb-97e5-4727-80ea-0a35778093fc-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Lock "cinder-5d0eabbb-97e5-4727-80ea-0a35778093fc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Acquiring lock "cinder-quobyte-5d0eabbb-97e5-4727-80ea-0a35778093fc" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Lock "cinder-quobyte-5d0eabbb-97e5-4727-80ea-0a35778093fc" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccd43e6-bd73-482b-88bb-8928f6a5a15e]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5d0eabbb-97e5-4727-80ea-0a35778093fc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:53 devstack sudo[85223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5d0eabbb-97e5-4727-80ea-0a35778093fc Apr 13 17:23:53 devstack sudo[85223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:54 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c0beefdf-ceb8-4507-9e13-e1849b01818a 1073741824" returned: 0 in 1.474s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:54 devstack sudo[85223]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5d0eabbb-97e5-4727-80ea-0a35778093fc" returned: 0 in 1.110s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5d0eabbb-97e5-4727-80ea-0a35778093fc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c0beefdf-ceb8-4507-9e13-e1849b01818a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:54 devstack sudo[85231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5d0eabbb-97e5-4727-80ea-0a35778093fc Apr 13 17:23:54 devstack sudo[85231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:54 devstack sudo[85232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c0beefdf-ceb8-4507-9e13-e1849b01818a Apr 13 17:23:54 devstack sudo[85232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:55 devstack sudo[85231]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5d0eabbb-97e5-4727-80ea-0a35778093fc" returned: 0 in 0.744s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Lock "cinder-quobyte-5d0eabbb-97e5-4727-80ea-0a35778093fc" released by "delete_volume" :: held 1.978s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Created reservations ['5d6fc296-8279-44c6-be0c-7c3c9b2a2d0d', '6a845ea7-b411-4c64-a135-5665f77b9611', '1d1cb0c8-bb53-4b99-9760-c5fb651e4055', '2d5e0d26-5313-480c-8ae7-ba19df1e77d7'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:55 devstack sudo[85248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:23:55 devstack sudo[85248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:55 devstack sudo[85232]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c0beefdf-ceb8-4507-9e13-e1849b01818a" returned: 0 in 1.018s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] <== create_volume: return (2600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.604s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e253c136-b7ad-44c8-bf15-126c8d3a7a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0beefdf-ceb8-4507-9e13-e1849b01818a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60d894b-0b6d-4f7f-917f-3e2513a563ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:23:55 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Volume volume-c0beefdf-ceb8-4507-9e13-e1849b01818a (c0beefdf-ceb8-4507-9e13-e1849b01818a): created successfully Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60d894b-0b6d-4f7f-917f-3e2513a563ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:23:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Flow 'volume_create_manager' (55228f15-96d4-48af-8e55-271fdbd0c2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:23:56 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ded643b1-3dd6-4a7a-ac10-a4a7d5947962 tempest-GroupsTest-1491399216 None] Created volume successfully. Apr 13 17:23:56 devstack sudo[85248]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 1.117s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:56 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:23:56 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Deleted volume successfully. Apr 13 17:23:56 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-4053c78a-6ab4-48bd-b937-81b90cf41d12 tempest-VolumesServicesTestJSON-1272469790 None] Lock "cinder-5d0eabbb-97e5-4727-80ea-0a35778093fc-delete_volume" released by "delete_volume" :: held 3.354s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:23:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Acquiring lock "cinder-quobyte-c0beefdf-ceb8-4507-9e13-e1849b01818a" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Lock "cinder-quobyte-c0beefdf-ceb8-4507-9e13-e1849b01818a" acquired by "delete_volume" :: waited 0.030s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:57 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[252a298e-f7bc-4a09-8dd3-16005b2bfa33]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c0beefdf-ceb8-4507-9e13-e1849b01818a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:57 devstack sudo[85319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c0beefdf-ceb8-4507-9e13-e1849b01818a Apr 13 17:23:57 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:58 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root Apr 13 17:23:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c0beefdf-ceb8-4507-9e13-e1849b01818a" returned: 0 in 1.298s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:23:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c0beefdf-ceb8-4507-9e13-e1849b01818a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:58 devstack sudo[85341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c0beefdf-ceb8-4507-9e13-e1849b01818a Apr 13 17:23:58 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:23:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Acquiring lock "cinder-64e590a1-8d43-4a4a-9b5f-6c4f24260c77-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Lock "cinder-64e590a1-8d43-4a4a-9b5f-6c4f24260c77-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Acquiring lock "cinder-quobyte-64e590a1-8d43-4a4a-9b5f-6c4f24260c77" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:23:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Lock "cinder-quobyte-64e590a1-8d43-4a4a-9b5f-6c4f24260c77" acquired by "delete_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:23:59 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[60272625-fb57-4c86-9e24-6c42674528d7]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:23:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:23:59 devstack sudo[85344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77 Apr 13 17:23:59 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:00 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c0beefdf-ceb8-4507-9e13-e1849b01818a" returned: 0 in 1.641s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Lock "cinder-quobyte-c0beefdf-ceb8-4507-9e13-e1849b01818a" released by "delete_volume" :: held 3.029s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:00 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77" returned: 0 in 1.238s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:00 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Created reservations ['d77bbeca-ebac-4abd-9880-7faa195cfc7c'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:00 devstack sudo[85352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77 Apr 13 17:24:00 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:00 devstack cinder-volume[81998]: WARNING cinder.quota [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-848813992 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-848813992, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:24:00 devstack cinder-volume[81998]: WARNING cinder.quota [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-848813992 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-848813992, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:24:00 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Created reservations ['df3d087d-e8b5-471f-a9db-17d0f94b2a37', 'e3684f45-b06c-4e02-93a9-96e8c7f5193b', 'd3b0e44e-2aa6-4902-848a-e95cd73636f3', '0a898ea3-f7b3-4aae-85bd-c0028d4f3c73'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:01 devstack sudo[85366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:01 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:01 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-64e590a1-8d43-4a4a-9b5f-6c4f24260c77" returned: 0 in 0.852s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Lock "cinder-quobyte-64e590a1-8d43-4a4a-9b5f-6c4f24260c77" released by "delete_volume" :: held 2.167s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:01 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Created reservations ['549dfdaf-9bf3-45ca-b1f8-3c04d8bc9f4c', '8630940a-c5fd-4397-8340-73c6818613b9', 'a6aa2c75-6f73-4a85-97a3-4df8027f7709', '9be28eb5-ec03-4c31-aa2f-9b577d8e1492'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:01 devstack sudo[85370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:01 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:01 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.823s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:01 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:01 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-968095ea-23e4-45de-b22b-5a1cc84cdccf tempest-GroupsTest-1491399216 None] Delete group completed successfully. Apr 13 17:24:02 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:02 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-669904dc-0983-4b20-adfd-af38790cbe83 tempest-GroupsTest-1491399216 None] Created reservations ['3cd929d0-18d4-4cd1-afbd-43b973cb79b2'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.623s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:02 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Deleted volume successfully. Apr 13 17:24:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-cb2b5873-6207-4c27-a10e-c9785af1d325 tempest-ServerRescueNegativeTestJSON-1353181555 None] Lock "cinder-64e590a1-8d43-4a4a-9b5f-6c4f24260c77-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-669904dc-0983-4b20-adfd-af38790cbe83 tempest-GroupsTest-1491399216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-669904dc-0983-4b20-adfd-af38790cbe83 tempest-GroupsTest-1491399216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-669904dc-0983-4b20-adfd-af38790cbe83 tempest-GroupsTest-1491399216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-669904dc-0983-4b20-adfd-af38790cbe83 tempest-GroupsTest-1491399216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-669904dc-0983-4b20-adfd-af38790cbe83 tempest-GroupsTest-1491399216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-669904dc-0983-4b20-adfd-af38790cbe83 tempest-GroupsTest-1491399216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:02 devstack sudo[85376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:02 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:03 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-669904dc-0983-4b20-adfd-af38790cbe83 tempest-GroupsTest-1491399216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.800s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:03 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-669904dc-0983-4b20-adfd-af38790cbe83 tempest-GroupsTest-1491399216 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:03 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-669904dc-0983-4b20-adfd-af38790cbe83 tempest-GroupsTest-1491399216 None] Delete group completed successfully. Apr 13 17:24:04 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-272d1787-24e8-4ce5-b646-6c5a5aa20d8c tempest-GroupsTest-1491399216 None] Group tempest-GroupsTest-Group-1224553978: creating Apr 13 17:24:04 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-272d1787-24e8-4ce5-b646-6c5a5aa20d8c tempest-GroupsTest-1491399216 None] Group tempest-GroupsTest-Group-1224553978: created successfully Apr 13 17:24:04 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-272d1787-24e8-4ce5-b646-6c5a5aa20d8c tempest-GroupsTest-1491399216 None] Create group completed successfully. Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Flow 'volume_create_manager' (a305bfec-6731-4a47-b462-4cdbbb22652a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3368a77-b6cc-4576-aa64-31c760865de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3368a77-b6cc-4576-aa64-31c760865de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-486641951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b64683-3239-4f38-9a87-f14e3cf796d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ca736d03824196b4acadf3b82e6415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:05Z,use_quota=True,user_id='745d8ee16613473a825eae508f695c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f66de3c5-0df4-45f5-a6eb-0d32ae5accaf),volume_type_id=f66de3c5-0df4-45f5-a6eb-0d32ae5accaf)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d9baae-277f-41d9-9385-bb758b6024f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d9baae-277f-41d9-9385-bb758b6024f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dce8756-dbb2-4b3c-839b-cd6603a0376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dce8756-dbb2-4b3c-839b-cd6603a0376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b64683-3239-4f38-9a87-f14e3cf796d1', 'volume_name': 'volume-48b64683-3239-4f38-9a87-f14e3cf796d1', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14599ac-3b63-43e9-9d3b-8ed5059aabd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14599ac-3b63-43e9-9d3b-8ed5059aabd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b3daff-426c-428f-8010-cfaaa5834407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:05 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Volume 48b64683-3239-4f38-9a87-f14e3cf796d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b64683-3239-4f38-9a87-f14e3cf796d1', 'volume_size': 1} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-486641951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b64683-3239-4f38-9a87-f14e3cf796d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ca736d03824196b4acadf3b82e6415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:05Z,use_quota=True,user_id='745d8ee16613473a825eae508f695c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f66de3c5-0df4-45f5-a6eb-0d32ae5accaf),volume_type_id=f66de3c5-0df4-45f5-a6eb-0d32ae5accaf)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Creating volume 48b64683-3239-4f38-9a87-f14e3cf796d1 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:24:05 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-48b64683-3239-4f38-9a87-f14e3cf796d1 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:05 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-48b64683-3239-4f38-9a87-f14e3cf796d1 1073741824 Apr 13 17:24:05 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Flow 'volume_create_manager' (6e9a7452-deca-477e-838c-b8f1a6beb502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc73fa4-d302-4ba2-8ca0-a28883271cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc73fa4-d302-4ba2-8ca0-a28883271cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-104413679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11a994e7-c77e-4ec2-8bdf-cf5105193b6c,host='devstack@QuobyteHD#QuobyteHD',id=ba4c226c-969b-4168-9a00-52fa0fb638ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b045d53eb86d4f52a844a169bf14c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:06Z,use_quota=True,user_id='cfa6707190924d68ae716603e61c44bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5070877-91d1-4023-be85-4221545559ef),volume_type_id=e5070877-91d1-4023-be85-4221545559ef)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad6c704-5858-4057-bc1c-38755c0ef37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad6c704-5858-4057-bc1c-38755c0ef37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afac1fb-0cff-4f6a-a088-81250dcd92c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afac1fb-0cff-4f6a-a088-81250dcd92c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4c226c-969b-4168-9a00-52fa0fb638ff', 'volume_name': 'volume-ba4c226c-969b-4168-9a00-52fa0fb638ff', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f4890a-a392-421a-ae4d-b1d82595504e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f4890a-a392-421a-ae4d-b1d82595504e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d3b9a8-0f88-43d8-b572-7cdf142e02b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:06 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Volume ba4c226c-969b-4168-9a00-52fa0fb638ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4c226c-969b-4168-9a00-52fa0fb638ff', 'volume_size': 1} Apr 13 17:24:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:06 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-48b64683-3239-4f38-9a87-f14e3cf796d1 1073741824" returned: 0 in 1.169s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-48b64683-3239-4f38-9a87-f14e3cf796d1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:06 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-48b64683-3239-4f38-9a87-f14e3cf796d1 Apr 13 17:24:06 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:07 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-48b64683-3239-4f38-9a87-f14e3cf796d1" returned: 0 in 0.530s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.971s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11a994e7-c77e-4ec2-8bdf-cf5105193b6c,created_at=2026-04-13T15:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-104413679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11a994e7-c77e-4ec2-8bdf-cf5105193b6c,host='devstack@QuobyteHD#QuobyteHD',id=ba4c226c-969b-4168-9a00-52fa0fb638ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b045d53eb86d4f52a844a169bf14c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:06Z,use_quota=True,user_id='cfa6707190924d68ae716603e61c44bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5070877-91d1-4023-be85-4221545559ef),volume_type_id=e5070877-91d1-4023-be85-4221545559ef)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Creating volume ba4c226c-969b-4168-9a00-52fa0fb638ff {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:24:07 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba4c226c-969b-4168-9a00-52fa0fb638ff 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b3daff-426c-428f-8010-cfaaa5834407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b64683-3239-4f38-9a87-f14e3cf796d1', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d722f20a-4092-414c-a3d9-59157a07c074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:07 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba4c226c-969b-4168-9a00-52fa0fb638ff 1073741824 Apr 13 17:24:07 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:07 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Volume volume-48b64683-3239-4f38-9a87-f14e3cf796d1 (48b64683-3239-4f38-9a87-f14e3cf796d1): created successfully Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d722f20a-4092-414c-a3d9-59157a07c074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Flow 'volume_create_manager' (a305bfec-6731-4a47-b462-4cdbbb22652a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:07 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-4384ad53-2e5b-4ad5-b9b0-9cfcbc991646 tempest-VolumeTypesAccessTest-2081526227 None] Created volume successfully. Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Acquiring lock "cinder-48b64683-3239-4f38-9a87-f14e3cf796d1-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Lock "cinder-48b64683-3239-4f38-9a87-f14e3cf796d1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Acquiring lock "cinder-quobyte-48b64683-3239-4f38-9a87-f14e3cf796d1" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Lock "cinder-quobyte-48b64683-3239-4f38-9a87-f14e3cf796d1" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cc1f39-ebcd-40e3-a1b0-97a06cf8088a]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-48b64683-3239-4f38-9a87-f14e3cf796d1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:07 devstack sudo[85470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-48b64683-3239-4f38-9a87-f14e3cf796d1 Apr 13 17:24:07 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:07 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba4c226c-969b-4168-9a00-52fa0fb638ff 1073741824" returned: 0 in 0.779s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba4c226c-969b-4168-9a00-52fa0fb638ff {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:07 devstack sudo[85473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba4c226c-969b-4168-9a00-52fa0fb638ff Apr 13 17:24:07 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:08 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-48b64683-3239-4f38-9a87-f14e3cf796d1" returned: 0 in 0.719s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-48b64683-3239-4f38-9a87-f14e3cf796d1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:08 devstack sudo[85479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-48b64683-3239-4f38-9a87-f14e3cf796d1 Apr 13 17:24:08 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:08 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba4c226c-969b-4168-9a00-52fa0fb638ff" returned: 0 in 0.632s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d3b9a8-0f88-43d8-b572-7cdf142e02b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4c226c-969b-4168-9a00-52fa0fb638ff', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0311fb5-8f3d-4e0d-bf0e-2e56b12c26b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:08 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Volume volume-ba4c226c-969b-4168-9a00-52fa0fb638ff (ba4c226c-969b-4168-9a00-52fa0fb638ff): created successfully Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0311fb5-8f3d-4e0d-bf0e-2e56b12c26b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Flow 'volume_create_manager' (6e9a7452-deca-477e-838c-b8f1a6beb502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:08 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-09a7ed2a-fcd9-40b7-acb7-36b0de08c004 tempest-GroupsTest-1491399216 None] Created volume successfully. Apr 13 17:24:08 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-48b64683-3239-4f38-9a87-f14e3cf796d1" returned: 0 in 0.497s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Lock "cinder-quobyte-48b64683-3239-4f38-9a87-f14e3cf796d1" released by "delete_volume" :: held 1.238s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:08 devstack cinder-volume[81998]: WARNING cinder.quota [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-197534637 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-197534637, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:24:08 devstack cinder-volume[81998]: WARNING cinder.quota [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-197534637 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-197534637, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Created reservations ['206f5bee-4a32-4216-8e91-bc2bb89a6ee6', '160bdb87-7842-4826-8df7-8cd8fecc7433', '3a658dd9-ada3-43d7-b82c-9ae84963101f', 'bed61671-0ec1-4da5-87ed-543a4c6d59ef'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:08 devstack sudo[85482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:08 devstack sudo[85482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:09 devstack sudo[85482]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.447s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:09 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Deleted volume successfully. Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f5b9fd40-87fd-442b-915d-0057825e9458 tempest-VolumeTypesAccessTest-2081526227 None] Lock "cinder-48b64683-3239-4f38-9a87-f14e3cf796d1-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Flow 'volume_create_manager' (94d5d157-bd12-40d4-bb08-ae2ad62dfc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5c9a67-447a-4e0c-8ff1-80bca72f60cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5c9a67-447a-4e0c-8ff1-80bca72f60cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-610917107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11a994e7-c77e-4ec2-8bdf-cf5105193b6c,host='devstack@QuobyteHD#QuobyteHD',id=7ece488b-48d1-4423-910e-67f10fbaac4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b045d53eb86d4f52a844a169bf14c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:09Z,use_quota=True,user_id='cfa6707190924d68ae716603e61c44bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5070877-91d1-4023-be85-4221545559ef),volume_type_id=e5070877-91d1-4023-be85-4221545559ef)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b2a356-2061-4c8e-94d6-90263a25bea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b2a356-2061-4c8e-94d6-90263a25bea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec43cb7-1f40-44eb-afd5-5715d12eb24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec43cb7-1f40-44eb-afd5-5715d12eb24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ece488b-48d1-4423-910e-67f10fbaac4d', 'volume_name': 'volume-7ece488b-48d1-4423-910e-67f10fbaac4d', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a76449-4234-4ec9-bfe6-592eb65c88b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a76449-4234-4ec9-bfe6-592eb65c88b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e145c75-79e4-4564-9d76-9e175578b423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:09 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Volume 7ece488b-48d1-4423-910e-67f10fbaac4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ece488b-48d1-4423-910e-67f10fbaac4d', 'volume_size': 1} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11a994e7-c77e-4ec2-8bdf-cf5105193b6c,created_at=2026-04-13T15:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-610917107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11a994e7-c77e-4ec2-8bdf-cf5105193b6c,host='devstack@QuobyteHD#QuobyteHD',id=7ece488b-48d1-4423-910e-67f10fbaac4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b045d53eb86d4f52a844a169bf14c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:09Z,use_quota=True,user_id='cfa6707190924d68ae716603e61c44bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5070877-91d1-4023-be85-4221545559ef),volume_type_id=e5070877-91d1-4023-be85-4221545559ef)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Creating volume 7ece488b-48d1-4423-910e-67f10fbaac4d {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:24:09 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:24:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ece488b-48d1-4423-910e-67f10fbaac4d 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:09 devstack sudo[85485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ece488b-48d1-4423-910e-67f10fbaac4d 1073741824 Apr 13 17:24:09 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:10 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ece488b-48d1-4423-910e-67f10fbaac4d 1073741824" returned: 0 in 1.118s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ece488b-48d1-4423-910e-67f10fbaac4d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:10 devstack sudo[85511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ece488b-48d1-4423-910e-67f10fbaac4d Apr 13 17:24:10 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:11 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ece488b-48d1-4423-910e-67f10fbaac4d" returned: 0 in 0.596s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:24:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:11 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e145c75-79e4-4564-9d76-9e175578b423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ece488b-48d1-4423-910e-67f10fbaac4d', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:11 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83f861c-aba3-46bd-bcfe-1eda99d8c0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:11 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Volume volume-7ece488b-48d1-4423-910e-67f10fbaac4d (7ece488b-48d1-4423-910e-67f10fbaac4d): created successfully Apr 13 17:24:11 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83f861c-aba3-46bd-bcfe-1eda99d8c0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:11 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Flow 'volume_create_manager' (94d5d157-bd12-40d4-bb08-ae2ad62dfc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:11 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-fdfba146-b3aa-48cc-baba-70c97f654d44 tempest-GroupsTest-1491399216 None] Created volume successfully. Apr 13 17:24:11 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-984166c7-7c95-4552-88ed-5d1e0331a1f1 tempest-GroupsTest-1491399216 None] Update group completed successfully. Apr 13 17:24:13 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-4fa734e5-1c74-4c92-b8e9-cccd216033a5 tempest-GroupsTest-1491399216 None] Update group completed successfully. Apr 13 17:24:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Acquiring lock "cinder-quobyte-7ece488b-48d1-4423-910e-67f10fbaac4d" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Lock "cinder-quobyte-7ece488b-48d1-4423-910e-67f10fbaac4d" acquired by "delete_volume" :: waited 0.016s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:14 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96fc562-3ff2-496e-b748-2164e98f4937]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ece488b-48d1-4423-910e-67f10fbaac4d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:14 devstack sudo[85545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ece488b-48d1-4423-910e-67f10fbaac4d Apr 13 17:24:14 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:15 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ece488b-48d1-4423-910e-67f10fbaac4d" returned: 0 in 0.859s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ece488b-48d1-4423-910e-67f10fbaac4d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:15 devstack sudo[85555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ece488b-48d1-4423-910e-67f10fbaac4d Apr 13 17:24:15 devstack sudo[85555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:16 devstack sudo[85555]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ece488b-48d1-4423-910e-67f10fbaac4d" returned: 0 in 0.589s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Lock "cinder-quobyte-7ece488b-48d1-4423-910e-67f10fbaac4d" released by "delete_volume" :: held 1.501s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Acquiring lock "cinder-quobyte-ba4c226c-969b-4168-9a00-52fa0fb638ff" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Lock "cinder-quobyte-ba4c226c-969b-4168-9a00-52fa0fb638ff" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:16 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[059069c9-de28-40da-afc9-4777c7fa1991]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba4c226c-969b-4168-9a00-52fa0fb638ff {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:16 devstack sudo[85560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba4c226c-969b-4168-9a00-52fa0fb638ff Apr 13 17:24:16 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:16 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba4c226c-969b-4168-9a00-52fa0fb638ff" returned: 0 in 0.678s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba4c226c-969b-4168-9a00-52fa0fb638ff {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:16 devstack sudo[85565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba4c226c-969b-4168-9a00-52fa0fb638ff Apr 13 17:24:16 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Flow 'volume_create_manager' (a0efeef4-9210-4e20-a82b-64d54785a077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82467fa9-5f32-4305-9769-ba2aec4db0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82467fa9-5f32-4305-9769-ba2aec4db0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1164749091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b9426f-ee4a-4b1b-a493-646ce1b1d00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee3454e71ef4a1887d11c0adb655ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:17Z,use_quota=True,user_id='710f8358aa264aa38ce338c299503252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c9235f-148e-4d96-8ea7-6affe47fc1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c9235f-148e-4d96-8ea7-6affe47fc1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358d3e7b-86a9-4b2a-9ca1-c600c70c192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358d3e7b-86a9-4b2a-9ca1-c600c70c192a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b9426f-ee4a-4b1b-a493-646ce1b1d00a', 'volume_name': 'volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f848f5b-0032-4d84-9dc1-73b8b4f9e9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f848f5b-0032-4d84-9dc1-73b8b4f9e9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (564b4ae0-66fa-4401-af1a-3a140bdda4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:17 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Volume 47b9426f-ee4a-4b1b-a493-646ce1b1d00a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a', 'volume_size': 1} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1164749091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b9426f-ee4a-4b1b-a493-646ce1b1d00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee3454e71ef4a1887d11c0adb655ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:17Z,use_quota=True,user_id='710f8358aa264aa38ce338c299503252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Creating volume 47b9426f-ee4a-4b1b-a493-646ce1b1d00a {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:24:17 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:17 devstack sudo[85567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a 1073741824 Apr 13 17:24:17 devstack sudo[85567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:17 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba4c226c-969b-4168-9a00-52fa0fb638ff" returned: 0 in 0.714s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Lock "cinder-quobyte-ba4c226c-969b-4168-9a00-52fa0fb638ff" released by "delete_volume" :: held 1.422s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Created reservations ['dee0c552-727f-4cfd-9f14-4798c0200da6'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:17 devstack cinder-volume[81998]: WARNING cinder.quota [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-496893758 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-496893758, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:24:17 devstack cinder-volume[81998]: WARNING cinder.quota [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-496893758 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-496893758, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Created reservations ['2c14077d-7615-4ff7-b2c2-028278fe32f5', '865c44ef-f408-4ce5-ac12-f0d9742eaeea', 'b2f46f62-a17b-4d5f-adf9-0c253ad223a5', '0798e737-e850-4139-9812-a68a277a6656'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Created reservations ['b34f0171-9915-4be4-91fd-a6ad9ce5256d', '211d88c3-fb00-4991-b82c-ebb49c433ebe', 'db15fd73-1f30-4f4b-aca7-07e257821e38', 'c75963e4-7f0b-44bd-be9a-ccc5a01e79f6'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:17 devstack sudo[85567]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a 1073741824" returned: 0 in 0.635s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:18 devstack sudo[85574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a Apr 13 17:24:18 devstack sudo[85574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:18 devstack sudo[85576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:18 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:18 devstack sudo[85574]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a" returned: 0 in 0.849s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (564b4ae0-66fa-4401-af1a-3a140bdda4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81052cd3-4bd5-46c1-ace4-169e7fa069b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:18 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Volume volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a (47b9426f-ee4a-4b1b-a493-646ce1b1d00a): created successfully Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81052cd3-4bd5-46c1-ace4-169e7fa069b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:18 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Flow 'volume_create_manager' (a0efeef4-9210-4e20-a82b-64d54785a077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.829s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:18 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:18 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-655f6b9c-11c3-40b6-bf4d-162525e5ccdc tempest-GroupsTest-1491399216 None] Delete group completed successfully. Apr 13 17:24:18 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-8a553a58-b4ec-457b-a53e-ac7a8fd937cc tempest-SnapshotMetadataTestJSON-2002247808 None] Created volume successfully. Apr 13 17:24:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] Creating offline snapshot aa592040-1b79-4229-b65e-dbcfda130752 of volume 47b9426f-ee4a-4b1b-a493-646ce1b1d00a {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:24:19 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[67555197-3694-4375-bcb3-b69f8fe6acb6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:19 devstack sudo[85580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a Apr 13 17:24:19 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:20 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a" returned: 0 in 1.025s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:20 devstack sudo[85587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 1G Apr 13 17:24:20 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:21 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 1G" returned: 0 in 0.947s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:21 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 Apr 13 17:24:21 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:22 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:24:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Flow 'volume_create_manager' (d538ca1e-6dcb-4828-90c1-e106bfb56b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09914d64-0bae-4785-a1cf-090f4bf12cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09914d64-0bae-4785-a1cf-090f4bf12cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:22Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe8acf7-2fb0-495a-8b73-ad1ea3076818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a262604ee9413288064924febb0418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:22Z,use_quota=True,user_id='e3dcfbaef6c643d0af7f25a4aeeadad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9672d219-4c7d-4f6f-aba0-34f53bdbc13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9672d219-4c7d-4f6f-aba0-34f53bdbc13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacd2e7b-945c-43e4-9c55-82ce19b7f03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:22 devstack cinder-volume[81998]: DEBUG cinder.image.glance [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Creating Keystone auth plugin from conf {{(pid=81998) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 17:24:23 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752" returned: 0 in 1.356s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:23 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 is being set with open permissions: ugo+rw Apr 13 17:24:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:23 devstack sudo[85604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 Apr 13 17:24:23 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacd2e7b-945c-43e4-9c55-82ce19b7f03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7fe8acf7-2fb0-495a-8b73-ad1ea3076818', 'volume_name': 'volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818', 'volume_size': 1, 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afd653b3e1644792a661ae2b4015619a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'created_at': datetime.datetime(2026, 4, 13, 15, 17, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/696022cb-dcc0-451a-9908-378fc3a9d5ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336820ca-ff1c-4e7d-a1da-345a162ed276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336820ca-ff1c-4e7d-a1da-345a162ed276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2a2584-6697-4775-9e00-15a50ac4c37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:23 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Volume 7fe8acf7-2fb0-495a-8b73-ad1ea3076818: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818', 'volume_size': 1, 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afd653b3e1644792a661ae2b4015619a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'created_at': datetime.datetime(2026, 4, 13, 15, 17, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/696022cb-dcc0-451a-9908-378fc3a9d5ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 17:24:23 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Trying to clone 7fe8acf7-2fb0-495a-8b73-ad1ea3076818 from image 696022cb-dcc0-451a-9908-378fc3a9d5ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]). {{(pid=81998) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 17:24:23 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81998) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 17:24:23 devstack cinder-volume[81998]: INFO cinder.image.image_utils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Image download 20.69 MB at 20.69 MB/s Apr 13 17:24:23 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[200e63d4-60c3-46d2-8c9c-81c7fd5bda60]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:23 devstack sudo[85630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD Apr 13 17:24:23 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752" returned: 0 in 0.995s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:24 devstack sudo[85630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:24 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.info Apr 13 17:24:24 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:24 devstack sudo[85630]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD" returned: 0 in 0.757s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:24 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Temporary image 696022cb-dcc0-451a-9908-378fc3a9d5ca is fetched for user e3dcfbaef6c643d0af7f25a4aeeadad2. {{(pid=81998) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 17:24:24 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[55222c01-bca4-4c86-9a1c-93ddc5016fec]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:24 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.info" returned: 0 in 0.755s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:24 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.info is being set with open permissions: ugo+rw Apr 13 17:24:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:24 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD Apr 13 17:24:24 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:24 devstack sudo[85639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.info Apr 13 17:24:24 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:25 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.info" returned: 0 in 0.655s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.905s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:25 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-3655f82e-b294-4fc7-9ad5-214d37a01665 tempest-SnapshotMetadataTestJSON-2002247808 None] Create snapshot completed successfully Apr 13 17:24:25 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD" returned: 0 in 0.965s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:22Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe8acf7-2fb0-495a-8b73-ad1ea3076818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a262604ee9413288064924febb0418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:22Z,use_quota=True,user_id='e3dcfbaef6c643d0af7f25a4aeeadad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Creating volume 7fe8acf7-2fb0-495a-8b73-ad1ea3076818 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:24:25 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:24:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:25 devstack sudo[85647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 1073741824 Apr 13 17:24:25 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:26 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 1073741824" returned: 0 in 0.702s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:26 devstack sudo[85653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 Apr 13 17:24:26 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Acquiring lock "cinder-aa592040-1b79-4229-b65e-dbcfda130752-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "cinder-aa592040-1b79-4229-b65e-dbcfda130752-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Acquiring lock "cinder-quobyte-47b9426f-ee4a-4b1b-a493-646ce1b1d00a" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "cinder-quobyte-47b9426f-ee4a-4b1b-a493-646ce1b1d00a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Acquiring lock "cinder-quobyte-aa592040-1b79-4229-b65e-dbcfda130752" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "cinder-quobyte-aa592040-1b79-4229-b65e-dbcfda130752" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Deleting offline snapshot aa592040-1b79-4229-b65e-dbcfda130752 of volume 47b9426f-ee4a-4b1b-a493-646ce1b1d00a {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:24:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] snapshot_file for this snap is: volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:24:26 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e05888a-fcbc-4129-a317-fcc7de849aea]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:26 devstack sudo[85655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 Apr 13 17:24:26 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:27 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818" returned: 0 in 0.713s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:24:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:27 devstack cinder-volume[81998]: DEBUG cinder.volume.volume_utils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Attempting download of 696022cb-dcc0-451a-9908-378fc3a9d5ca ((None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}])) to volume 7fe8acf7-2fb0-495a-8b73-ad1ea3076818. {{(pid=81998) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 17:24:27 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[500655bd-cff0-4ed0-a2bf-fe773311d3ac]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_uj19obb3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:27 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_uj19obb3 Apr 13 17:24:27 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:27 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-0570cf41-ef8f-499f-8992-baa38becebde tempest-GroupSnapshotsV319Test-667365178 None] Group tempest-GroupSnapshotsV319Test-Group-1488560783: creating Apr 13 17:24:27 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-0570cf41-ef8f-499f-8992-baa38becebde tempest-GroupSnapshotsV319Test-667365178 None] Group tempest-GroupSnapshotsV319Test-Group-1488560783: created successfully Apr 13 17:24:27 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-0570cf41-ef8f-499f-8992-baa38becebde tempest-GroupSnapshotsV319Test-667365178 None] Create group completed successfully. Apr 13 17:24:27 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752" returned: 0 in 0.933s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:24:27 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac419986-fca0-46a0-bee5-a1c26688f522]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:27 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a Apr 13 17:24:27 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:27 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_uj19obb3" returned: 0 in 0.871s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_uj19obb3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:28 devstack sudo[85703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_uj19obb3 Apr 13 17:24:28 devstack sudo[85703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:28 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a" returned: 0 in 0.611s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:28 devstack sudo[85708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 Apr 13 17:24:28 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:28 devstack sudo[85703]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_uj19obb3" returned: 1 in 0.641s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_uj19obb3' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:24:28 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b765a5-45ff-4369-9c81-6886e102474e]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:28 devstack sudo[85712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD Apr 13 17:24:28 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:29 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752" returned: 0 in 0.586s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:29 devstack sudo[85717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752 Apr 13 17:24:29 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Flow 'volume_create_manager' (bb7ab6da-3ed4-4802-bae6-2c4ef7593041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8424fe-e847-4f35-a48b-3c9be2711d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8424fe-e847-4f35-a48b-3c9be2711d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2124446106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a4a4b6a-9e93-4c2c-ab00-de9cdeeedf5c,host='devstack@QuobyteHD#QuobyteHD',id=d333d89a-022d-4b4b-95b2-d692f057feac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b221f7c7c5240299425e7936c4200e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:29Z,use_quota=True,user_id='86d930796cc54ff7ab8ff1bd9a43a965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb281a10-dc7c-42f7-abc2-8fd318ab1c50),volume_type_id=bb281a10-dc7c-42f7-abc2-8fd318ab1c50)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373988ff-d36c-42f3-a5d8-f3839bbd8edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373988ff-d36c-42f3-a5d8-f3839bbd8edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898a421c-b398-4607-a711-e0d4bff4bdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898a421c-b398-4607-a711-e0d4bff4bdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd333d89a-022d-4b4b-95b2-d692f057feac', 'volume_name': 'volume-d333d89a-022d-4b4b-95b2-d692f057feac', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcd4e7e-84f5-4f57-9390-27e819085f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcd4e7e-84f5-4f57-9390-27e819085f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5b2fda-3197-4cd2-b437-1e8cb76feb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:29 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Volume d333d89a-022d-4b4b-95b2-d692f057feac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d333d89a-022d-4b4b-95b2-d692f057feac', 'volume_size': 1} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3a4a4b6a-9e93-4c2c-ab00-de9cdeeedf5c,created_at=2026-04-13T15:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2124446106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a4a4b6a-9e93-4c2c-ab00-de9cdeeedf5c,host='devstack@QuobyteHD#QuobyteHD',id=d333d89a-022d-4b4b-95b2-d692f057feac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b221f7c7c5240299425e7936c4200e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:29Z,use_quota=True,user_id='86d930796cc54ff7ab8ff1bd9a43a965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb281a10-dc7c-42f7-abc2-8fd318ab1c50),volume_type_id=bb281a10-dc7c-42f7-abc2-8fd318ab1c50)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Creating volume d333d89a-022d-4b4b-95b2-d692f057feac {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:24:29 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:29 devstack sudo[85723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac 1073741824 Apr 13 17:24:29 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:29 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a.aa592040-1b79-4229-b65e-dbcfda130752" returned: 0 in 0.595s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "cinder-quobyte-aa592040-1b79-4229-b65e-dbcfda130752" released by "_delete_snapshot" :: held 2.837s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "cinder-quobyte-47b9426f-ee4a-4b1b-a493-646ce1b1d00a" released by "delete_snapshot" :: held 2.855s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:29 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD" returned: 0 in 1.076s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] 696022cb-dcc0-451a-9908-378fc3a9d5ca was qcow2, converting to raw {{(pid=81998) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Created reservations ['4f4ee8e8-8a28-4c3f-942d-381ae4ebdd28', '9c423cc6-bc36-4f27-a782-660e4ccc4cba', '3d75ab4c-124b-4b6a-98ff-d2fe4ee47eb1', '3047b344-a6b3-4ef5-8ea4-d10962acd4c3'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:29 devstack sudo[85725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 Apr 13 17:24:29 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:29 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Delete snapshot completed successfully. Apr 13 17:24:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03de148d-e9e1-463d-a91a-23d21122009f tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "cinder-aa592040-1b79-4229-b65e-dbcfda130752-delete_snapshot" released by "delete_snapshot" :: held 3.012s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Acquiring lock "cinder-47b9426f-ee4a-4b1b-a493-646ce1b1d00a-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "cinder-47b9426f-ee4a-4b1b-a493-646ce1b1d00a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Acquiring lock "cinder-quobyte-47b9426f-ee4a-4b1b-a493-646ce1b1d00a" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "cinder-quobyte-47b9426f-ee4a-4b1b-a493-646ce1b1d00a" acquired by "delete_volume" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:30 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[24565ea8-253e-4b10-92b1-01e55f4da54c]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:30 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac 1073741824" returned: 0 in 0.810s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:30 devstack sudo[85736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac Apr 13 17:24:30 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:30 devstack sudo[85731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a Apr 13 17:24:30 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:31 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a" returned: 0 in 0.862s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:31 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818" returned: 0 in 1.479s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_r7stos40devstack@QuobyteHD, size 112.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:24:31 devstack cinder-volume[81998]: INFO cinder.image.image_utils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Converted 112.00 MB image at 75.64 MB/s Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:31 devstack sudo[85775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a Apr 13 17:24:31 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:31 devstack sudo[85778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 1G Apr 13 17:24:31 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:31 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac" returned: 0 in 0.899s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5b2fda-3197-4cd2-b437-1e8cb76feb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d333d89a-022d-4b4b-95b2-d692f057feac', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9247f092-12f4-483a-9d10-b9783c467b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:31 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Volume volume-d333d89a-022d-4b4b-95b2-d692f057feac (d333d89a-022d-4b4b-95b2-d692f057feac): created successfully Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9247f092-12f4-483a-9d10-b9783c467b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Flow 'volume_create_manager' (bb7ab6da-3ed4-4802-bae6-2c4ef7593041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:31 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-6f629860-3dea-4a0e-8546-1f9caa91761c tempest-GroupSnapshotsV319Test-667365178 None] Created volume successfully. Apr 13 17:24:31 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-47b9426f-ee4a-4b1b-a493-646ce1b1d00a" returned: 0 in 0.571s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "cinder-quobyte-47b9426f-ee4a-4b1b-a493-646ce1b1d00a" released by "delete_volume" :: held 1.479s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Created reservations ['a00f4c84-2b1e-4f40-8b2a-d3a8ebcf2b53', '0856594c-5cdb-4820-9b42-b044d126fcb5', 'cb081b2d-2be5-41ae-9e93-190604945ae6', '698d098c-7239-484b-a570-f51f74eaab91'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:31 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] GroupSnapshot 5f49f596-04c3-4e09-93db-683902c9920c: creating. Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] Group snapshot 5f49f596-04c3-4e09-93db-683902c9920c: creating. {{(pid=81998) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] Creating offline snapshot 05864ae0-c75e-4bad-b8c1-bfface54e94c of volume d333d89a-022d-4b4b-95b2-d692f057feac {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[857bc1cc-6dee-4b47-9a21-aecc82fdd14d]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:31 devstack sudo[85785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:31 devstack sudo[85785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:32 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 1G" returned: 0 in 0.842s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9e5ab2-e5b2-4a28-98ac-7445b335d322]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:32 devstack sudo[85786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac Apr 13 17:24:32 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:32 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 Apr 13 17:24:32 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:32 devstack sudo[85785]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.624s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:32 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:32 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Deleted volume successfully. Apr 13 17:24:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e7e36ff7-9cef-4170-9c3a-a3d0e4205947 tempest-SnapshotMetadataTestJSON-2002247808 None] Lock "cinder-47b9426f-ee4a-4b1b-a493-646ce1b1d00a-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:32 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac" returned: 0 in 0.833s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:32 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818" returned: 0 in 0.759s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:32 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c 1G Apr 13 17:24:32 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:33 devstack sudo[85798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 Apr 13 17:24:33 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG oslo_service.periodic_task [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:33 devstack sudo[85803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:33 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:33 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818" returned: 1 in 1.002s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG cinder.volume.volume_utils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Downloaded image 696022cb-dcc0-451a-9908-378fc3a9d5ca ((None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}])) to volume 7fe8acf7-2fb0-495a-8b73-ad1ea3076818 successfully. {{(pid=81998) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Temporary image 696022cb-dcc0-451a-9908-378fc3a9d5ca for user e3dcfbaef6c643d0af7f25a4aeeadad2 is deleted. {{(pid=81998) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG cinder.volume.volume_utils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Marking volume 7fe8acf7-2fb0-495a-8b73-ad1ea3076818 as bootable. {{(pid=81998) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Copying metadata from image 696022cb-dcc0-451a-9908-378fc3a9d5ca to 7fe8acf7-2fb0-495a-8b73-ad1ea3076818. {{(pid=81998) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Creating volume glance metadata for volume 7fe8acf7-2fb0-495a-8b73-ad1ea3076818 backed by image 696022cb-dcc0-451a-9908-378fc3a9d5ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81998) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2a2584-6697-4775-9e00-15a50ac4c37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818', 'volume_size': 1, 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afd653b3e1644792a661ae2b4015619a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'created_at': datetime.datetime(2026, 4, 13, 15, 17, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/696022cb-dcc0-451a-9908-378fc3a9d5ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dbdd2c-7d93-4450-8eae-7a69577fa1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:34 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c 1G" returned: 0 in 1.232s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d333d89a-022d-4b4b-95b2-d692f057feac -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:34 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Volume volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 (7fe8acf7-2fb0-495a-8b73-ad1ea3076818): created successfully Apr 13 17:24:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dbdd2c-7d93-4450-8eae-7a69577fa1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Flow 'volume_create_manager' (d538ca1e-6dcb-4828-90c1-e106bfb56b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:34 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d333d89a-022d-4b4b-95b2-d692f057feac -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c Apr 13 17:24:34 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:34 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-6a296edb-278a-4eef-8a52-470f81171a3a tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Created volume successfully. Apr 13 17:24:34 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.785s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:34 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d333d89a-022d-4b4b-95b2-d692f057feac -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c" returned: 0 in 0.959s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:34 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:24:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:35 devstack sudo[85822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c Apr 13 17:24:35 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-96d03257-e4d5-4e64-9689-59465b4f0eaa tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Flow 'volume_create_manager' (fb51120f-495f-4122-8fa7-fc12461a5253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56470089-efe3-4235-8ee5-67ae4b2ddccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56470089-efe3-4235-8ee5-67ae4b2ddccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2093538824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ac62b4-832a-47de-b277-9fb80e9b66b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e13c5707d7a5455893cafeb83d140391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:35Z,use_quota=True,user_id='ff8119afcb274b8b806961985bead31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd76439-e4dd-47a1-83b9-2f88a38a8d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd76439-e4dd-47a1-83b9-2f88a38a8d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ce21be-cb84-43b2-b274-518f971fa7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ce21be-cb84-43b2-b274-518f971fa7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8ac62b4-832a-47de-b277-9fb80e9b66b0', 'volume_name': 'volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9feaa993-8580-40e1-aeff-3adf58011811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9feaa993-8580-40e1-aeff-3adf58011811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1408cc91-4e48-40b5-9862-83f223c0bba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:35 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Volume f8ac62b4-832a-47de-b277-9fb80e9b66b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0', 'volume_size': 1} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:35 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c" returned: 0 in 0.620s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:35 devstack sudo[85827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.info Apr 13 17:24:35 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:36 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.info" returned: 0 in 0.520s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:36 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:36 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.info Apr 13 17:24:36 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:36 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.info" returned: 0 in 0.525s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.755s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-96d03257-e4d5-4e64-9689-59465b4f0eaa tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.570s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d062396-7609-4ab0-8b90-c95709244071]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-96d03257-e4d5-4e64-9689-59465b4f0eaa tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Flow 'volume_create_manager' (30bbe76e-8312-4eb3-89dc-ea312d4ccfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb76502-328d-450e-9740-59d9579e0361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:36 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 Apr 13 17:24:36 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb76502-328d-450e-9740-59d9579e0361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-116057504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92cf96c-5c78-48cb-9c6a-072613522b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c3eda0e54e4a6e97ef534a3d5d0d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:37Z,use_quota=True,user_id='9a5b65bf2ed64b9e8a1df5d2e39905bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed1b1d8-bdca-425b-975e-170a7aa4e51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed1b1d8-bdca-425b-975e-170a7aa4e51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c80a2b-81ab-4c33-8a47-32df7f9880c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c80a2b-81ab-4c33-8a47-32df7f9880c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b92cf96c-5c78-48cb-9c6a-072613522b63', 'volume_name': 'volume-b92cf96c-5c78-48cb-9c6a-072613522b63', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0320f6d2-e22c-4fca-b4ae-f50cb5255719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0320f6d2-e22c-4fca-b4ae-f50cb5255719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547bd839-bc32-4665-a5d0-f0e7605db53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:36 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Volume b92cf96c-5c78-48cb-9c6a-072613522b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b92cf96c-5c78-48cb-9c6a-072613522b63', 'volume_size': 1} Apr 13 17:24:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:36 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-22524928-f540-42cd-86bb-1f20d5aebf7f tempest-GroupSnapshotsV319Test-667365178 None] group_snapshot 5f49f596-04c3-4e09-93db-683902c9920c: created successfully Apr 13 17:24:37 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-96d03257-e4d5-4e64-9689-59465b4f0eaa tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818" returned: 0 in 0.504s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-96d03257-e4d5-4e64-9689-59465b4f0eaa tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:37 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 Apr 13 17:24:37 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:37 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] group_snapshot 5f49f596-04c3-4e09-93db-683902c9920c: deleting Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] group_snapshot 5f49f596-04c3-4e09-93db-683902c9920c: deleting {{(pid=81998) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Acquiring lock "cinder-quobyte-d333d89a-022d-4b4b-95b2-d692f057feac" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Lock "cinder-quobyte-d333d89a-022d-4b4b-95b2-d692f057feac" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Acquiring lock "cinder-quobyte-05864ae0-c75e-4bad-b8c1-bfface54e94c" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Lock "cinder-quobyte-05864ae0-c75e-4bad-b8c1-bfface54e94c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Deleting offline snapshot 05864ae0-c75e-4bad-b8c1-bfface54e94c of volume d333d89a-022d-4b4b-95b2-d692f057feac {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] snapshot_file for this snap is: volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:24:37 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-96d03257-e4d5-4e64-9689-59465b4f0eaa tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818" returned: 1 in 0.560s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-96d03257-e4d5-4e64-9689-59465b4f0eaa tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-96d03257-e4d5-4e64-9689-59465b4f0eaa tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.109s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4623f57-ed90-4c2d-aeed-dfdf28eac335]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.408s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2093538824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ac62b4-832a-47de-b277-9fb80e9b66b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e13c5707d7a5455893cafeb83d140391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:35Z,use_quota=True,user_id='ff8119afcb274b8b806961985bead31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Creating volume f8ac62b4-832a-47de-b277-9fb80e9b66b0 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:24:37 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:37 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0 1073741824 Apr 13 17:24:37 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-96d03257-e4d5-4e64-9689-59465b4f0eaa tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6', 'name': 'volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92f76f68-b0c0-4720-b154-cb599abdf036', 'enforce_multipath': True} {{(pid=81998) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 17:24:37 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-2d588a51-709c-4575-bf15-6689710ce9a8 req-96d03257-e4d5-4e64-9689-59465b4f0eaa tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] attachment_update completed successfully. Apr 13 17:24:37 devstack sudo[85845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c Apr 13 17:24:37 devstack sudo[85845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:38 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0 1073741824" returned: 0 in 0.531s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:38 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0 Apr 13 17:24:38 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:38 devstack sudo[85845]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c" returned: 0 in 0.582s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d333d89a-022d-4b4b-95b2-d692f057feac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9875f7ae-aff1-4520-9c45-729362a94e58]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:38 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac Apr 13 17:24:38 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:38 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0" returned: 0 in 0.480s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.038s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-116057504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92cf96c-5c78-48cb-9c6a-072613522b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c3eda0e54e4a6e97ef534a3d5d0d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:37Z,use_quota=True,user_id='9a5b65bf2ed64b9e8a1df5d2e39905bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Creating volume b92cf96c-5c78-48cb-9c6a-072613522b63 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:24:38 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b92cf96c-5c78-48cb-9c6a-072613522b63 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:38 devstack sudo[85862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b92cf96c-5c78-48cb-9c6a-072613522b63 1073741824 Apr 13 17:24:38 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1408cc91-4e48-40b5-9862-83f223c0bba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fabf7b8c-83fc-4b95-8715-e9b9feec4943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:38 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Volume volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0 (f8ac62b4-832a-47de-b277-9fb80e9b66b0): created successfully Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fabf7b8c-83fc-4b95-8715-e9b9feec4943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Flow 'volume_create_manager' (fb51120f-495f-4122-8fa7-fc12461a5253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:38 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-cd2275de-eb30-4708-b8e2-d203012d1c29 tempest-VolumesMetadataTest-193483422 None] Created volume successfully. Apr 13 17:24:38 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac" returned: 0 in 0.524s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:38 devstack sudo[85864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c Apr 13 17:24:38 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:39 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b92cf96c-5c78-48cb-9c6a-072613522b63 1073741824" returned: 0 in 0.519s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b92cf96c-5c78-48cb-9c6a-072613522b63 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:39 devstack sudo[85872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b92cf96c-5c78-48cb-9c6a-072613522b63 Apr 13 17:24:39 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:39 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c" returned: 0 in 0.486s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:39 devstack sudo[85874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c Apr 13 17:24:39 devstack sudo[85874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:39 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b92cf96c-5c78-48cb-9c6a-072613522b63" returned: 0 in 0.542s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:39 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:24:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547bd839-bc32-4665-a5d0-f0e7605db53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b92cf96c-5c78-48cb-9c6a-072613522b63', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22a34fe-6777-4cf8-9a6c-fb7d62d44f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:39 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Volume volume-b92cf96c-5c78-48cb-9c6a-072613522b63 (b92cf96c-5c78-48cb-9c6a-072613522b63): created successfully Apr 13 17:24:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22a34fe-6777-4cf8-9a6c-fb7d62d44f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Flow 'volume_create_manager' (30bbe76e-8312-4eb3-89dc-ea312d4ccfbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:40 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-eb1ba1fc-939b-49a0-8ea6-14184f01096d tempest-VolumeQuotasAdminTestJSON-1353218835 None] Created volume successfully. Apr 13 17:24:40 devstack sudo[85874]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac.05864ae0-c75e-4bad-b8c1-bfface54e94c" returned: 0 in 0.560s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:40 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Lock "cinder-quobyte-05864ae0-c75e-4bad-b8c1-bfface54e94c" released by "_delete_snapshot" :: held 2.264s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:40 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Lock "cinder-quobyte-d333d89a-022d-4b4b-95b2-d692f057feac" released by "delete_snapshot" :: held 2.279s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:40 devstack cinder-volume[81998]: WARNING cinder.quota [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1916619185 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1916619185, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:24:40 devstack cinder-volume[81998]: WARNING cinder.quota [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1916619185 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1916619185, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:24:40 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] Created reservations ['52cb36e1-627f-410d-b1d5-bf4e10dcef4b', '4aa6c4b9-d797-4005-bee4-6940261081ed', 'f3e7bbf6-31aa-4133-8d74-223cf4bc193e', '6c1a7755-ced0-4c19-98ca-8120177482d3'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:40 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ccf74bb5-eb62-475d-ac32-c24782184889 tempest-GroupSnapshotsV319Test-667365178 None] group_snapshot 5f49f596-04c3-4e09-93db-683902c9920c: deleted successfully Apr 13 17:24:40 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Acquiring lock "cinder-f8ac62b4-832a-47de-b277-9fb80e9b66b0-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:40 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Lock "cinder-f8ac62b4-832a-47de-b277-9fb80e9b66b0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:40 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Acquiring lock "cinder-quobyte-f8ac62b4-832a-47de-b277-9fb80e9b66b0" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:40 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Lock "cinder-quobyte-f8ac62b4-832a-47de-b277-9fb80e9b66b0" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:40 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd7d1f5-f18a-40ca-a9e1-ec38b90ac5d7]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:40 devstack sudo[85878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0 Apr 13 17:24:40 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:40 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0" returned: 0 in 0.476s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:40 devstack sudo[85883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0 Apr 13 17:24:40 devstack sudo[85883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Acquiring lock "cinder-b92cf96c-5c78-48cb-9c6a-072613522b63-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "cinder-b92cf96c-5c78-48cb-9c6a-072613522b63-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Acquiring lock "cinder-quobyte-b92cf96c-5c78-48cb-9c6a-072613522b63" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "cinder-quobyte-b92cf96c-5c78-48cb-9c6a-072613522b63" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[db76c58d-f4ac-49df-9da2-84eb06cf20c0]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b92cf96c-5c78-48cb-9c6a-072613522b63 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Acquiring lock "cinder-quobyte-d333d89a-022d-4b4b-95b2-d692f057feac" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Lock "cinder-quobyte-d333d89a-022d-4b4b-95b2-d692f057feac" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:41 devstack sudo[85889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b92cf96c-5c78-48cb-9c6a-072613522b63 Apr 13 17:24:41 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[61963d74-bcbe-4598-bde5-d96db0e23d82]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:41 devstack sudo[85883]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8ac62b4-832a-47de-b277-9fb80e9b66b0" returned: 0 in 0.482s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Lock "cinder-quobyte-f8ac62b4-832a-47de-b277-9fb80e9b66b0" released by "delete_volume" :: held 0.991s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Created reservations ['a83ef607-4f8e-4502-8b8b-592848b38ab2', '10e6bb2e-2307-4788-a318-2792930feed3', '959b190b-0485-4d0f-862d-e7d150fb60a4', 'aae12f11-8f4f-4ad1-b2ec-2b29436968d7'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:41 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:41 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:41 devstack sudo[85893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:41 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:41 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b92cf96c-5c78-48cb-9c6a-072613522b63" returned: 0 in 0.508s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b92cf96c-5c78-48cb-9c6a-072613522b63 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:41 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b92cf96c-5c78-48cb-9c6a-072613522b63 Apr 13 17:24:41 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:41 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:41 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.431s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac" returned: 0 in 0.534s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:41 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Deleted volume successfully. Apr 13 17:24:41 devstack sudo[85904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac Apr 13 17:24:41 devstack sudo[85904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5b906aa5-d991-4f9f-ba8e-6349af91a0f9 tempest-VolumesMetadataTest-193483422 None] Lock "cinder-f8ac62b4-832a-47de-b277-9fb80e9b66b0-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:42 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b92cf96c-5c78-48cb-9c6a-072613522b63" returned: 0 in 0.448s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "cinder-quobyte-b92cf96c-5c78-48cb-9c6a-072613522b63" released by "delete_volume" :: held 0.987s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Created reservations ['01c71629-d4e6-42f9-9bd0-604b97bb3265', '19b18824-774d-4fee-8801-9936ec5e69d6', '280431ab-0bd9-47c8-b31c-3d91bed28b1c', 'a1c4f015-c201-4ebe-b061-df433bfe0dba'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:42 devstack sudo[85904]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d333d89a-022d-4b4b-95b2-d692f057feac" returned: 0 in 0.442s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Lock "cinder-quobyte-d333d89a-022d-4b4b-95b2-d692f057feac" released by "delete_volume" :: held 1.040s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:42 devstack sudo[85908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:42 devstack sudo[85908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Created reservations ['7babb67a-b81f-4e0b-ad79-f8361f589084'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:42 devstack cinder-volume[81998]: WARNING cinder.quota [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1916619185 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1916619185, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Created reservations ['8faa0c42-80f6-4468-89de-9dc1e43b8646', '84da120c-620e-49bd-8947-777b83816b5d', '3927d9cb-3695-456b-a8f1-ee49979d2ef0', '1dd1ead8-5d3c-44cf-8801-4fa7e39b95ba'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:42 devstack sudo[85933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:42 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Flow 'volume_create_manager' (943fc20a-4319-4133-afc2-91d3969191bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014dfa9f-5fb8-4d3b-924e-948bd325c1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014dfa9f-5fb8-4d3b-924e-948bd325c1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-335501910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c889fac8-4396-478c-b9c2-dc5712ed7510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c3eda0e54e4a6e97ef534a3d5d0d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:43Z,use_quota=True,user_id='9a5b65bf2ed64b9e8a1df5d2e39905bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba62a81-00cc-4ea0-a826-fa8481f973fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba62a81-00cc-4ea0-a826-fa8481f973fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433f76ce-b0b5-42fb-960f-f3ab41176721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433f76ce-b0b5-42fb-960f-f3ab41176721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c889fac8-4396-478c-b9c2-dc5712ed7510', 'volume_name': 'volume-c889fac8-4396-478c-b9c2-dc5712ed7510', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2980609c-e96d-4daf-888b-53fa1fe43d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2980609c-e96d-4daf-888b-53fa1fe43d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8859f4-a272-4731-8d8d-13b143f77325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:42 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Volume c889fac8-4396-478c-b9c2-dc5712ed7510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c889fac8-4396-478c-b9c2-dc5712ed7510', 'volume_size': 1} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-335501910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c889fac8-4396-478c-b9c2-dc5712ed7510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c3eda0e54e4a6e97ef534a3d5d0d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:43Z,use_quota=True,user_id='9a5b65bf2ed64b9e8a1df5d2e39905bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Creating volume c889fac8-4396-478c-b9c2-dc5712ed7510 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:24:42 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:24:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c889fac8-4396-478c-b9c2-dc5712ed7510 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:42 devstack sudo[85938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c889fac8-4396-478c-b9c2-dc5712ed7510 1073741824 Apr 13 17:24:42 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:43 devstack sudo[85908]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.903s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:43 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:43 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Deleted volume successfully. Apr 13 17:24:43 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5de047e7-5ec6-408b-9233-c8ed5d668d42 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "cinder-b92cf96c-5c78-48cb-9c6a-072613522b63-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:43 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 1.293s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:43 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:43 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-6e420a2b-51a9-49d7-9665-efa8609cd9f0 tempest-GroupSnapshotsV319Test-667365178 None] Delete group completed successfully. Apr 13 17:24:43 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c889fac8-4396-478c-b9c2-dc5712ed7510 1073741824" returned: 0 in 1.063s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c889fac8-4396-478c-b9c2-dc5712ed7510 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:43 devstack sudo[85947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c889fac8-4396-478c-b9c2-dc5712ed7510 Apr 13 17:24:43 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:44 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c889fac8-4396-478c-b9c2-dc5712ed7510" returned: 0 in 0.826s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:24:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:44 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=135,cinder:UPDATE=148,cinder:INSERT=32,cinder:DELETE=11 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:24:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8859f4-a272-4731-8d8d-13b143f77325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c889fac8-4396-478c-b9c2-dc5712ed7510', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f472fd65-f1db-474c-b754-1278782c1942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:44 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:UPDATE=166,cinder:SELECT=149,cinder:INSERT=51,cinder:DELETE=6 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:24:44 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Volume volume-c889fac8-4396-478c-b9c2-dc5712ed7510 (c889fac8-4396-478c-b9c2-dc5712ed7510): created successfully Apr 13 17:24:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f472fd65-f1db-474c-b754-1278782c1942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Flow 'volume_create_manager' (943fc20a-4319-4133-afc2-91d3969191bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:44 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-629e2a65-f3d3-4232-8b69-c549847b3e75 tempest-VolumeQuotasAdminTestJSON-1353218835 None] Created volume successfully. Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Flow 'volume_create_manager' (29d2239a-f700-479c-9650-121e45678428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e31b3b5-3d6d-41b9-b8a4-727869107025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e31b3b5-3d6d-41b9-b8a4-727869107025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-438877172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8150f54-a841-4f68-9986-fa62fb630e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3958a015fa07421d9da339433bf17fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:46Z,use_quota=True,user_id='906a652b14e94f4fa02a6273402572c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b94cd8-bcab-441f-96c2-91c37dfe443a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b94cd8-bcab-441f-96c2-91c37dfe443a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25fa62a-f465-49fd-8011-a597aeb3b203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25fa62a-f465-49fd-8011-a597aeb3b203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8150f54-a841-4f68-9986-fa62fb630e31', 'volume_name': 'volume-f8150f54-a841-4f68-9986-fa62fb630e31', 'volume_size': 2}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95699684-20c3-4631-abad-ece4323e72e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95699684-20c3-4631-abad-ece4323e72e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ca733d-331a-42b8-a375-6e74ea29f25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:46 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Volume f8150f54-a841-4f68-9986-fa62fb630e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8150f54-a841-4f68-9986-fa62fb630e31', 'volume_size': 2} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-438877172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8150f54-a841-4f68-9986-fa62fb630e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3958a015fa07421d9da339433bf17fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:46Z,use_quota=True,user_id='906a652b14e94f4fa02a6273402572c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Creating volume f8150f54-a841-4f68-9986-fa62fb630e31 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:24:46 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:24:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8150f54-a841-4f68-9986-fa62fb630e31 2147483648 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:46 devstack sudo[85952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8150f54-a841-4f68-9986-fa62fb630e31 2147483648 Apr 13 17:24:46 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:46 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e3d3bee5-558b-4e93-906e-ee002d476e72 tempest-VolumeQuotasAdminTestJSON-1696567621 None] Transfer volume completed successfully. Apr 13 17:24:47 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8150f54-a841-4f68-9986-fa62fb630e31 2147483648" returned: 0 in 0.796s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8150f54-a841-4f68-9986-fa62fb630e31 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:47 devstack sudo[85958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8150f54-a841-4f68-9986-fa62fb630e31 Apr 13 17:24:47 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Acquiring lock "cinder-c889fac8-4396-478c-b9c2-dc5712ed7510-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Lock "cinder-c889fac8-4396-478c-b9c2-dc5712ed7510-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Acquiring lock "cinder-quobyte-c889fac8-4396-478c-b9c2-dc5712ed7510" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Lock "cinder-quobyte-c889fac8-4396-478c-b9c2-dc5712ed7510" acquired by "delete_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfb5e46-a0d3-495a-9c64-1d637d4b5562]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c889fac8-4396-478c-b9c2-dc5712ed7510 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:47 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c889fac8-4396-478c-b9c2-dc5712ed7510 Apr 13 17:24:47 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:47 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8150f54-a841-4f68-9986-fa62fb630e31" returned: 0 in 0.597s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ca733d-331a-42b8-a375-6e74ea29f25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8150f54-a841-4f68-9986-fa62fb630e31', 'volume_size': 2}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4efd05-6963-4064-84ea-6737186a60ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:47 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Volume volume-f8150f54-a841-4f68-9986-fa62fb630e31 (f8150f54-a841-4f68-9986-fa62fb630e31): created successfully Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4efd05-6963-4064-84ea-6737186a60ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Flow 'volume_create_manager' (29d2239a-f700-479c-9650-121e45678428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:47 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-df92f36a-cfff-4251-a204-3e8a7f125a92 tempest-VolumesCloneNegativeTest-1697531908 None] Created volume successfully. Apr 13 17:24:48 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c889fac8-4396-478c-b9c2-dc5712ed7510" returned: 0 in 0.730s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c889fac8-4396-478c-b9c2-dc5712ed7510 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:48 devstack sudo[85966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c889fac8-4396-478c-b9c2-dc5712ed7510 Apr 13 17:24:48 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Acquiring lock "cinder-f8150f54-a841-4f68-9986-fa62fb630e31-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Lock "cinder-f8150f54-a841-4f68-9986-fa62fb630e31-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Acquiring lock "cinder-quobyte-f8150f54-a841-4f68-9986-fa62fb630e31" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Lock "cinder-quobyte-f8150f54-a841-4f68-9986-fa62fb630e31" acquired by "delete_volume" :: waited 0.026s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:48 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2950e3ba-b314-4d05-98e8-b646d6fe2a6d]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8150f54-a841-4f68-9986-fa62fb630e31 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:48 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f030ca9c-2203-4a5a-a0b5-5a498b090a03 tempest-GroupsV320Test-347473045 None] Group tempest-GroupsV320Test-Group-959304677: creating Apr 13 17:24:48 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f030ca9c-2203-4a5a-a0b5-5a498b090a03 tempest-GroupsV320Test-347473045 None] Group tempest-GroupsV320Test-Group-959304677: created successfully Apr 13 17:24:48 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f030ca9c-2203-4a5a-a0b5-5a498b090a03 tempest-GroupsV320Test-347473045 None] Create group completed successfully. Apr 13 17:24:48 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8150f54-a841-4f68-9986-fa62fb630e31 Apr 13 17:24:48 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:48 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c889fac8-4396-478c-b9c2-dc5712ed7510" returned: 0 in 0.643s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Lock "cinder-quobyte-c889fac8-4396-478c-b9c2-dc5712ed7510" released by "delete_volume" :: held 1.402s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Created reservations ['7c138483-2dd4-450b-b9ea-ea186a592976', '66bb0e38-a9e9-4090-a206-e3a775354e47', 'fc8f5ac6-1a4b-4ebc-8d7a-0cb0198cb2fd', '2ca0f126-b385-427b-9d20-07a02634cd21'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:49 devstack sudo[85971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:49 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:49 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8150f54-a841-4f68-9986-fa62fb630e31" returned: 0 in 0.525s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8150f54-a841-4f68-9986-fa62fb630e31 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:49 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8150f54-a841-4f68-9986-fa62fb630e31 Apr 13 17:24:49 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:49 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.438s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:49 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Deleted volume successfully. Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-611bdd37-f21b-4c4a-8fcd-52c1b3fe363c tempest-VolumeQuotasAdminTestJSON-1962409071 None] Lock "cinder-c889fac8-4396-478c-b9c2-dc5712ed7510-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:49 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f8150f54-a841-4f68-9986-fa62fb630e31" returned: 0 in 0.425s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Lock "cinder-quobyte-f8150f54-a841-4f68-9986-fa62fb630e31" released by "delete_volume" :: held 0.994s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Created reservations ['95326abc-cb63-4cac-9ced-bda6fb50ace2', 'a11bde14-c015-413a-9457-ff395ec5abde', 'b825ae5c-3c77-452d-a7db-4952f12e30e8', '4c7ccd7e-6ea3-4a01-9e0d-5edb2e650689'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:49 devstack sudo[85980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:49 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:50 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.492s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:50 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:50 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-921fccf5-ee11-40f2-b67e-54f618ff70b5 tempest-GroupsV320Test-347473045 None] Created reservations ['df36bd51-a1c6-4da5-bb93-0a2ce512e3aa'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:24:50 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Deleted volume successfully. Apr 13 17:24:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-921fccf5-ee11-40f2-b67e-54f618ff70b5 tempest-GroupsV320Test-347473045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-921fccf5-ee11-40f2-b67e-54f618ff70b5 tempest-GroupsV320Test-347473045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-921fccf5-ee11-40f2-b67e-54f618ff70b5 tempest-GroupsV320Test-347473045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-921fccf5-ee11-40f2-b67e-54f618ff70b5 tempest-GroupsV320Test-347473045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-921fccf5-ee11-40f2-b67e-54f618ff70b5 tempest-GroupsV320Test-347473045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-921fccf5-ee11-40f2-b67e-54f618ff70b5 tempest-GroupsV320Test-347473045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1e2181aa-8cb6-4923-825d-ffda5a84ae87 tempest-VolumesCloneNegativeTest-1697531908 None] Lock "cinder-f8150f54-a841-4f68-9986-fa62fb630e31-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:24:50 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:24:50 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:50 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-921fccf5-ee11-40f2-b67e-54f618ff70b5 tempest-GroupsV320Test-347473045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.470s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:50 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-921fccf5-ee11-40f2-b67e-54f618ff70b5 tempest-GroupsV320Test-347473045 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:24:50 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-921fccf5-ee11-40f2-b67e-54f618ff70b5 tempest-GroupsV320Test-347473045 None] Delete group completed successfully. Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Flow 'volume_create_manager' (37982372-9b58-40da-b51c-3eedfcdbc9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafcf419-bad1-48f5-9797-8f87c21ea7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafcf419-bad1-48f5-9797-8f87c21ea7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1078109841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b51339dbbc49ac8a7f47a92c7b3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:56Z,use_quota=True,user_id='d395716add3f4a46a59d1d551fd70178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f8bb63-0cfd-4999-83ff-7d078c6850a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f8bb63-0cfd-4999-83ff-7d078c6850a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e100873-c8a9-46cf-b643-b2c3e7bfe87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e100873-c8a9-46cf-b643-b2c3e7bfe87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4', 'volume_name': 'volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c9fa54-5d44-4c9a-8a61-b11728e60a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c9fa54-5d44-4c9a-8a61-b11728e60a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea055bc-c37d-4de7-8bd3-1ac67903cda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:55 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Volume 39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4', 'volume_size': 1} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1078109841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b51339dbbc49ac8a7f47a92c7b3974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:24:56Z,use_quota=True,user_id='d395716add3f4a46a59d1d551fd70178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Creating volume 39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:24:55 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:24:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:55 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4 1073741824 Apr 13 17:24:55 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:56 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4 1073741824" returned: 0 in 0.543s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:56 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4 Apr 13 17:24:56 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:24:56 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Apr 13 17:24:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4" returned: 0 in 0.519s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:24:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:24:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:24:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea055bc-c37d-4de7-8bd3-1ac67903cda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa527ef-2c48-425d-8a5c-8942567f2226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:24:56 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Volume volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4 (39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4): created successfully Apr 13 17:24:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa527ef-2c48-425d-8a5c-8942567f2226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:24:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Flow 'volume_create_manager' (37982372-9b58-40da-b51c-3eedfcdbc9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:24:56 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-eb47ba56-40a7-4670-a410-38e81205403d tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Created volume successfully. Apr 13 17:24:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Acquiring lock "cinder-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Lock "cinder-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Acquiring lock "cinder-quobyte-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:24:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Lock "cinder-quobyte-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:24:59 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8726bf7c-b2fd-4184-a9d7-878532e8a5f4]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:24:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:24:59 devstack sudo[86091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4 Apr 13 17:24:59 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:00 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4" returned: 0 in 1.239s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:00 devstack sudo[86097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4 Apr 13 17:25:00 devstack sudo[86097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:01 devstack sudo[86097]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4" returned: 0 in 0.634s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Lock "cinder-quobyte-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4" released by "delete_volume" :: held 1.927s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:01 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Created reservations ['27e20531-d35f-4a89-80a9-45b0209a21e6', 'fcdabb50-e498-4290-a943-865cf726046e', '32377e4b-1bb1-43c1-b5bc-f5f1cbe7ca76', 'cb5fb319-3c2f-4aa9-b2b1-910be234f7a3'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:01 devstack sudo[86100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:01 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:02 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.812s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:02 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Deleted volume successfully. Apr 13 17:25:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6dcc63aa-aae7-47a6-a2ab-d7d62169597c tempest-VolumeQuotasNegativeTestJSON-1817518639 None] Lock "cinder-39ede1e1-8a9a-4f7c-b8fd-852461ec3cd4-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Flow 'volume_create_manager' (4133b8ca-4d9a-428b-b240-baa6b9c1a8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e080c68-fb54-414d-a04b-441c0b12a4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e080c68-fb54-414d-a04b-441c0b12a4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1568996320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30789ce-b0c2-458f-93a1-eb6260f4856c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0b1fbb05de44b890a14eb5823cd6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:03Z,use_quota=True,user_id='2d1b8de3caf14a00b581722a3e9df9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe26aea-507f-4f43-bc05-959a1c3269e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe26aea-507f-4f43-bc05-959a1c3269e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a3e05d-f3b8-4da2-a97e-520b06740fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a3e05d-f3b8-4da2-a97e-520b06740fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30789ce-b0c2-458f-93a1-eb6260f4856c', 'volume_name': 'volume-e30789ce-b0c2-458f-93a1-eb6260f4856c', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96daf0b-2825-41ea-9f37-390379477aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96daf0b-2825-41ea-9f37-390379477aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149754f9-c9f4-40b5-9fc0-d0bf662259ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:03 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Volume e30789ce-b0c2-458f-93a1-eb6260f4856c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30789ce-b0c2-458f-93a1-eb6260f4856c', 'volume_size': 1} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1568996320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30789ce-b0c2-458f-93a1-eb6260f4856c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0b1fbb05de44b890a14eb5823cd6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:03Z,use_quota=True,user_id='2d1b8de3caf14a00b581722a3e9df9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Creating volume e30789ce-b0c2-458f-93a1-eb6260f4856c {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:25:03 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:25:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:03 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c 1073741824 Apr 13 17:25:03 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:04 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c 1073741824" returned: 0 in 0.925s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:04 devstack sudo[86294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c Apr 13 17:25:04 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:05 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c" returned: 0 in 0.605s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:25:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149754f9-c9f4-40b5-9fc0-d0bf662259ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30789ce-b0c2-458f-93a1-eb6260f4856c', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2dec46-0838-4c39-a023-0b66d01bf137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:05 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Volume volume-e30789ce-b0c2-458f-93a1-eb6260f4856c (e30789ce-b0c2-458f-93a1-eb6260f4856c): created successfully Apr 13 17:25:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2dec46-0838-4c39-a023-0b66d01bf137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Flow 'volume_create_manager' (4133b8ca-4d9a-428b-b240-baa6b9c1a8ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:05 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-edf1e837-6a84-4685-9981-4653abcebb38 tempest-VolumesSnapshotTestJSON-707237842 None] Created volume successfully. Apr 13 17:25:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] Creating offline snapshot b16ff649-276a-4a94-8841-0621da804aea of volume e30789ce-b0c2-458f-93a1-eb6260f4856c {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:25:05 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b47d63-e870-4e52-aa48-641cba702200]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:06 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c Apr 13 17:25:06 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Flow 'volume_create_manager' (abb8b9a4-5408-45f1-bd22-af29bea2aa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400ce4e0-a634-4e17-a869-ded2ed3e6110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400ce4e0-a634-4e17-a869-ded2ed3e6110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1276150038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba25c4ad-a9d3-4118-9e75-c2065c26622f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d031220ebc445fbab3c6cce7986435e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:06Z,use_quota=True,user_id='5bf5850c25164561852007e85b25c17a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57adcf5f-e254-48c8-980c-2b4a58d5a43d),volume_type_id=57adcf5f-e254-48c8-980c-2b4a58d5a43d)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d0c699-f987-44d4-ac4d-fc7e001e7330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d0c699-f987-44d4-ac4d-fc7e001e7330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78d9400-20d9-44cf-b5bb-7415e900a73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78d9400-20d9-44cf-b5bb-7415e900a73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba25c4ad-a9d3-4118-9e75-c2065c26622f', 'volume_name': 'volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d981a27-4ac9-487d-8e28-38c3e3602a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d981a27-4ac9-487d-8e28-38c3e3602a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a657f4c-4da3-4b09-a9d9-462b0115a93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:06 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Volume ba25c4ad-a9d3-4118-9e75-c2065c26622f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f', 'volume_size': 1} Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:06 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c" returned: 0 in 0.839s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:06 devstack sudo[86324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea 1G Apr 13 17:25:06 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:07 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea 1G" returned: 0 in 0.598s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30789ce-b0c2-458f-93a1-eb6260f4856c -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:07 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30789ce-b0c2-458f-93a1-eb6260f4856c -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea Apr 13 17:25:07 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:07 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30789ce-b0c2-458f-93a1-eb6260f4856c -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea" returned: 0 in 0.571s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:07 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea is being set with open permissions: ugo+rw Apr 13 17:25:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:07 devstack sudo[86336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea Apr 13 17:25:07 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:08 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea" returned: 0 in 0.616s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:08 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.info Apr 13 17:25:08 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:09 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.info" returned: 0 in 0.559s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:09 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.info is being set with open permissions: ugo+rw Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:09 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.info Apr 13 17:25:09 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:09 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-f6f0eed7-3743-4f33-93a8-258dba29cf27 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Terminate volume connection completed successfully. Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-f6f0eed7-3743-4f33-93a8-258dba29cf27 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Deleting attachment 92f76f68-b0c0-4720-b154-cb599abdf036. {{(pid=81998) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 17:25:09 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.info" returned: 0 in 0.525s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.788s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.084s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1276150038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba25c4ad-a9d3-4118-9e75-c2065c26622f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d031220ebc445fbab3c6cce7986435e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:06Z,use_quota=True,user_id='5bf5850c25164561852007e85b25c17a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57adcf5f-e254-48c8-980c-2b4a58d5a43d),volume_type_id=57adcf5f-e254-48c8-980c-2b4a58d5a43d)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Creating volume ba25c4ad-a9d3-4118-9e75-c2065c26622f {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:25:09 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:09 devstack sudo[86347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f 1073741824 Apr 13 17:25:09 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:09 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-7555b3de-1532-4013-8158-642e50ef1435 tempest-VolumesSnapshotTestJSON-707237842 None] Create snapshot completed successfully Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Acquiring lock "cinder-7fe8acf7-2fb0-495a-8b73-ad1ea3076818-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "cinder-7fe8acf7-2fb0-495a-8b73-ad1ea3076818-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Acquiring lock "cinder-quobyte-7fe8acf7-2fb0-495a-8b73-ad1ea3076818" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "cinder-quobyte-7fe8acf7-2fb0-495a-8b73-ad1ea3076818" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aa8b00-7a83-49e7-bfa2-466cd9621f13]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:10 devstack sudo[86349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 Apr 13 17:25:10 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-b16ff649-276a-4a94-8841-0621da804aea-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-b16ff649-276a-4a94-8841-0621da804aea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-e30789ce-b0c2-458f-93a1-eb6260f4856c" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-e30789ce-b0c2-458f-93a1-eb6260f4856c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-b16ff649-276a-4a94-8841-0621da804aea" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-b16ff649-276a-4a94-8841-0621da804aea" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Deleting offline snapshot b16ff649-276a-4a94-8841-0621da804aea of volume e30789ce-b0c2-458f-93a1-eb6260f4856c {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] snapshot_file for this snap is: volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b91e59d-c6eb-4bb1-a801-572d2f5fd5ab]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:10 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea Apr 13 17:25:10 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:10 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f 1073741824" returned: 0 in 0.685s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:10 devstack sudo[86356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f Apr 13 17:25:10 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:10 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818" returned: 0 in 0.778s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:10 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 Apr 13 17:25:10 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:10 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea" returned: 0 in 0.618s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e30789ce-b0c2-458f-93a1-eb6260f4856c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[058ce57d-5107-4b50-be07-ad6e01a895bb]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:10 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f" returned: 0 in 0.514s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:25:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:11 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a657f4c-4da3-4b09-a9d9-462b0115a93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:11 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ffa0e5-1dc9-4ad9-8068-bc096711d694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:11 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Volume volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f (ba25c4ad-a9d3-4118-9e75-c2065c26622f): created successfully Apr 13 17:25:11 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ffa0e5-1dc9-4ad9-8068-bc096711d694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:11 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c Apr 13 17:25:11 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Flow 'volume_create_manager' (abb8b9a4-5408-45f1-bd22-af29bea2aa04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:11 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:11 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e7a70a90-9da1-459d-a480-bec8411c2cc9 tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Created volume successfully. Apr 13 17:25:11 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818" returned: 1 in 0.613s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:25:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:11 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818 Apr 13 17:25:11 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:11 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c" returned: 0 in 0.592s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:11 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea Apr 13 17:25:11 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:11 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fe8acf7-2fb0-495a-8b73-ad1ea3076818" returned: 0 in 0.518s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "cinder-quobyte-7fe8acf7-2fb0-495a-8b73-ad1ea3076818" released by "delete_volume" :: held 1.957s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:11 devstack cinder-volume[81998]: DEBUG cinder.quota [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Created reservations ['b87d4aaa-e1df-4c94-8e74-adba6cbe7904', 'df9a5382-fa7e-46d0-9466-a4b5e59aeec0', '8cc39b07-5d9e-4df6-825d-fad6991c0392', '4f8fa49d-c63d-4060-9956-5b56e481cb22'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:12 devstack sudo[86383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:12 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f0591695-1f35-4cab-96de-7d6897dcea5a tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f0591695-1f35-4cab-96de-7d6897dcea5a tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f0591695-1f35-4cab-96de-7d6897dcea5a tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f0591695-1f35-4cab-96de-7d6897dcea5a tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f0591695-1f35-4cab-96de-7d6897dcea5a tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f0591695-1f35-4cab-96de-7d6897dcea5a tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:12 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:12 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:12 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea" returned: 0 in 0.673s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:12 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea Apr 13 17:25:12 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:12 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.588s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG cinder.manager [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:12 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Deleted volume successfully. Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-68008278-8735-4fbf-980b-8b6ec0b02cbc req-c05fed70-9522-4694-8498-c85dafc028a3 tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "cinder-7fe8acf7-2fb0-495a-8b73-ad1ea3076818-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:12 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f0591695-1f35-4cab-96de-7d6897dcea5a tempest-VolumeRetypeWithoutMigrationTest-492115642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.523s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f0591695-1f35-4cab-96de-7d6897dcea5a tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:12 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f0591695-1f35-4cab-96de-7d6897dcea5a tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Retype volume completed successfully. Apr 13 17:25:12 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c.b16ff649-276a-4a94-8841-0621da804aea" returned: 0 in 0.558s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-b16ff649-276a-4a94-8841-0621da804aea" released by "_delete_snapshot" :: held 2.501s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-e30789ce-b0c2-458f-93a1-eb6260f4856c" released by "delete_snapshot" :: held 2.513s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Created reservations ['3b71650e-75f1-4957-9ae2-3b1a57ef0382', 'd7a0fb7c-dc2f-4529-8d61-de5b4aca60b6', 'e3d3b22e-e831-4ae3-9370-efc5fa896eca', 'f2d128e4-fa68-4a62-840c-fa2ffc3dab84'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:12 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Delete snapshot completed successfully. Apr 13 17:25:12 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e693ea0f-fa82-4819-9b27-9a0f4f5901eb tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-b16ff649-276a-4a94-8841-0621da804aea-delete_snapshot" released by "delete_snapshot" :: held 2.637s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Acquiring lock "cinder-ba25c4ad-a9d3-4118-9e75-c2065c26622f-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Lock "cinder-ba25c4ad-a9d3-4118-9e75-c2065c26622f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Acquiring lock "cinder-quobyte-ba25c4ad-a9d3-4118-9e75-c2065c26622f" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Lock "cinder-quobyte-ba25c4ad-a9d3-4118-9e75-c2065c26622f" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c75b9c3-cbbf-49f1-a9d6-d1eb90455384]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:13 devstack sudo[86393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f Apr 13 17:25:13 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Flow 'volume_create_manager' (4f21f334-e85d-4b40-b530-fde7543064bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feda2034-3019-4560-8dfb-bbce156b5fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feda2034-3019-4560-8dfb-bbce156b5fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-742456801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e426f3b2-379f-4b9e-aade-a9252006eb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0b1fbb05de44b890a14eb5823cd6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:14Z,use_quota=True,user_id='2d1b8de3caf14a00b581722a3e9df9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3048de-707f-4a46-b656-0cf1adef04da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3048de-707f-4a46-b656-0cf1adef04da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ebee02-0bc4-47dc-a32c-1e8fa7b3b1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ebee02-0bc4-47dc-a32c-1e8fa7b3b1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e426f3b2-379f-4b9e-aade-a9252006eb6c', 'volume_name': 'volume-e426f3b2-379f-4b9e-aade-a9252006eb6c', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c7d164-ebe5-42dd-b589-7909cdfd9ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c7d164-ebe5-42dd-b589-7909cdfd9ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0878c362-150c-43ad-bc5c-49bc3b7b01af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:13 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Volume e426f3b2-379f-4b9e-aade-a9252006eb6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e426f3b2-379f-4b9e-aade-a9252006eb6c', 'volume_size': 1} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-742456801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e426f3b2-379f-4b9e-aade-a9252006eb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0b1fbb05de44b890a14eb5823cd6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:14Z,use_quota=True,user_id='2d1b8de3caf14a00b581722a3e9df9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Creating volume e426f3b2-379f-4b9e-aade-a9252006eb6c {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:25:13 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:25:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:13 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c 1073741824 Apr 13 17:25:13 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:14 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f" returned: 0 in 0.614s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:14 devstack sudo[86400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f Apr 13 17:25:14 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:14 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c 1073741824" returned: 0 in 0.779s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:14 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c Apr 13 17:25:14 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:14 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ba25c4ad-a9d3-4118-9e75-c2065c26622f" returned: 0 in 0.711s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Lock "cinder-quobyte-ba25c4ad-a9d3-4118-9e75-c2065c26622f" released by "delete_volume" :: held 1.358s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:14 devstack cinder-volume[81998]: WARNING cinder.quota [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:25:14 devstack cinder-volume[81998]: WARNING cinder.quota [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:25:14 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Created reservations ['fd6b8d5b-b0d7-480b-8761-cb0507ebeef0', 'eadeaf20-ba50-4054-845e-03af3dfccabd', '1db5237c-5e97-4860-8828-2175807502d9', '92dbb41a-7e1f-476e-bdc5-11a920883667'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:15 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:15 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:15 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c" returned: 0 in 0.571s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0878c362-150c-43ad-bc5c-49bc3b7b01af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e426f3b2-379f-4b9e-aade-a9252006eb6c', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8f79bd-44eb-40a3-952f-6df527eecfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:15 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Volume volume-e426f3b2-379f-4b9e-aade-a9252006eb6c (e426f3b2-379f-4b9e-aade-a9252006eb6c): created successfully Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8f79bd-44eb-40a3-952f-6df527eecfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Flow 'volume_create_manager' (4f21f334-e85d-4b40-b530-fde7543064bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:15 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d8fe20de-ea6c-4137-8265-3d15d77310d7 tempest-VolumesSnapshotTestJSON-707237842 None] Created volume successfully. Apr 13 17:25:15 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.538s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:15 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Deleted volume successfully. Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-58d1d9dc-0f32-46ef-943d-f479c24e69cc tempest-VolumeRetypeWithoutMigrationTest-492115642 None] Lock "cinder-ba25c4ad-a9d3-4118-9e75-c2065c26622f-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Flow 'volume_create_manager' (91e5fff8-259a-40cf-9cad-6c979de91d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370920b8-dff4-40a6-8b11-b94096f3cc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370920b8-dff4-40a6-8b11-b94096f3cc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-567927695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dacd1d3-7755-4cd0-bbd6-d3165b0651cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af67c276b42d493bb8ae8a4841c8f1be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:16Z,use_quota=True,user_id='100d340c0c3740d8ae146fd92d6d6cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7306d1d7-1d10-45f3-8ce2-ceeeda501f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7306d1d7-1d10-45f3-8ce2-ceeeda501f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d13bd8-b429-411f-9b3e-0f144a9bc2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d13bd8-b429-411f-9b3e-0f144a9bc2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dacd1d3-7755-4cd0-bbd6-d3165b0651cc', 'volume_name': 'volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff000969-2e8a-4cbe-a4ec-5eb861d1dd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff000969-2e8a-4cbe-a4ec-5eb861d1dd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (290989f0-b293-45c5-98c8-b06f5cc2b0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:15 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Volume 8dacd1d3-7755-4cd0-bbd6-d3165b0651cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc', 'volume_size': 1} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-567927695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dacd1d3-7755-4cd0-bbd6-d3165b0651cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af67c276b42d493bb8ae8a4841c8f1be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:16Z,use_quota=True,user_id='100d340c0c3740d8ae146fd92d6d6cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Creating volume 8dacd1d3-7755-4cd0-bbd6-d3165b0651cc {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:25:15 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:25:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:15 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc 1073741824 Apr 13 17:25:15 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:16 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc 1073741824" returned: 0 in 0.777s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:16 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc Apr 13 17:25:16 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:16 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc" returned: 0 in 0.457s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.818s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (290989f0-b293-45c5-98c8-b06f5cc2b0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6b0cea-77f7-4401-92f1-702a1fb142ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:16 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Volume volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc (8dacd1d3-7755-4cd0-bbd6-d3165b0651cc): created successfully Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6b0cea-77f7-4401-92f1-702a1fb142ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Flow 'volume_create_manager' (91e5fff8-259a-40cf-9cad-6c979de91d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] Creating offline snapshot f510ce9a-b33b-487c-94ca-1ec555e65dff of volume e426f3b2-379f-4b9e-aade-a9252006eb6c {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:25:16 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-6e7b2ae8-cb5e-4824-9945-bddf5e842f21 tempest-VolumesListAdminTestJSON-1240577543 None] Created volume successfully. Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1674f04d-99b0-42c7-9bfe-706c470b88ab]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:17 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c Apr 13 17:25:17 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:17 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c" returned: 0 in 0.532s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:17 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff 1G Apr 13 17:25:17 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Flow 'volume_create_manager' (5baac7a6-5543-402f-98ae-8832fc5da7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48b297a-87e3-42bd-ad9c-612c2a990ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48b297a-87e3-42bd-ad9c-612c2a990ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-912180515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5898987f-099f-48ec-a491-d60f7f9ee857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af67c276b42d493bb8ae8a4841c8f1be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:18Z,use_quota=True,user_id='100d340c0c3740d8ae146fd92d6d6cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12c8aae-18ae-4dce-b1e3-70932eeb0859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12c8aae-18ae-4dce-b1e3-70932eeb0859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218753f1-5ee6-47b5-b914-0377d9999fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218753f1-5ee6-47b5-b914-0377d9999fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5898987f-099f-48ec-a491-d60f7f9ee857', 'volume_name': 'volume-5898987f-099f-48ec-a491-d60f7f9ee857', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eba49e2-396f-4998-93b3-8843000f828d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eba49e2-396f-4998-93b3-8843000f828d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d706780-1a5a-470d-a625-95fc79bb77c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:18 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Volume 5898987f-099f-48ec-a491-d60f7f9ee857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5898987f-099f-48ec-a491-d60f7f9ee857', 'volume_size': 1} Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:18 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff 1G" returned: 0 in 0.673s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e426f3b2-379f-4b9e-aade-a9252006eb6c -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:18 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e426f3b2-379f-4b9e-aade-a9252006eb6c -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff Apr 13 17:25:18 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:18 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e426f3b2-379f-4b9e-aade-a9252006eb6c -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff" returned: 0 in 0.541s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:18 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff is being set with open permissions: ugo+rw Apr 13 17:25:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:18 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff Apr 13 17:25:18 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:19 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff" returned: 0 in 0.456s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:19 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.info Apr 13 17:25:19 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:19 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.info" returned: 0 in 0.488s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:19 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.info is being set with open permissions: ugo+rw Apr 13 17:25:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:19 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.info Apr 13 17:25:19 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Flow 'volume_create_manager' (084c0988-287a-4888-bbae-0cd56c23c9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df4886b-61c7-48d4-a1d9-85c3938ece18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df4886b-61c7-48d4-a1d9-85c3938ece18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-946770495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='858817ba736847ba9634faa337779bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:20Z,use_quota=True,user_id='d2ef1a9f931740bd8eb4549f4e835e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bcd1e8-f9cd-4edc-92a7-a2ac2e965121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bcd1e8-f9cd-4edc-92a7-a2ac2e965121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae80e02-f045-48d7-a8f9-486dd049e2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae80e02-f045-48d7-a8f9-486dd049e2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5', 'volume_name': 'volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e86390-a5fa-46a9-bfa8-e8502753f38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e86390-a5fa-46a9-bfa8-e8502753f38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030c0762-2e5e-43b9-b9ae-06dd8c691b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:20 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Volume 17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5', 'volume_size': 1} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:20 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.info" returned: 0 in 0.473s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.249s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.059s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-912180515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5898987f-099f-48ec-a491-d60f7f9ee857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af67c276b42d493bb8ae8a4841c8f1be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:18Z,use_quota=True,user_id='100d340c0c3740d8ae146fd92d6d6cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Creating volume 5898987f-099f-48ec-a491-d60f7f9ee857 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:25:20 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5898987f-099f-48ec-a491-d60f7f9ee857 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:20 devstack sudo[86565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5898987f-099f-48ec-a491-d60f7f9ee857 1073741824 Apr 13 17:25:20 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:20 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-fe2a7d2d-d6d3-4990-88f3-6aff7410bac1 tempest-VolumesSnapshotTestJSON-707237842 None] Create snapshot completed successfully Apr 13 17:25:20 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5898987f-099f-48ec-a491-d60f7f9ee857 1073741824" returned: 0 in 0.500s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5898987f-099f-48ec-a491-d60f7f9ee857 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:20 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5898987f-099f-48ec-a491-d60f7f9ee857 Apr 13 17:25:20 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:21 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5898987f-099f-48ec-a491-d60f7f9ee857" returned: 0 in 0.489s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.091s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-946770495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='858817ba736847ba9634faa337779bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:20Z,use_quota=True,user_id='d2ef1a9f931740bd8eb4549f4e835e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Creating volume 17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:25:21 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d706780-1a5a-470d-a625-95fc79bb77c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5898987f-099f-48ec-a491-d60f7f9ee857', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:21 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 1073741824 Apr 13 17:25:21 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68d1c29-87aa-4a90-a6b6-613bd8379493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:21 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Volume volume-5898987f-099f-48ec-a491-d60f7f9ee857 (5898987f-099f-48ec-a491-d60f7f9ee857): created successfully Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68d1c29-87aa-4a90-a6b6-613bd8379493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Flow 'volume_create_manager' (5baac7a6-5543-402f-98ae-8832fc5da7f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:21 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-742a3b46-504a-42ee-b6fb-d3bdd3ecdb97 tempest-VolumesListAdminTestJSON-1240577543 None] Created volume successfully. Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Flow 'volume_create_manager' (35fc4896-13e2-486f-8b06-45998775e5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e0be25-6698-44ec-b42c-d6a812d72b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e0be25-6698-44ec-b42c-d6a812d72b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1697572334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea25c27-f920-48df-8102-ad4f98f02af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0b1fbb05de44b890a14eb5823cd6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f510ce9a-b33b-487c-94ca-1ec555e65dff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:22Z,use_quota=True,user_id='2d1b8de3caf14a00b581722a3e9df9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49cd43d7-ff67-4483-bf01-c5df4be56977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49cd43d7-ff67-4483-bf01-c5df4be56977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfc1aeb-f314-434d-b6bf-ffc0290f1f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfc1aeb-f314-434d-b6bf-ffc0290f1f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ea25c27-f920-48df-8102-ad4f98f02af3', 'volume_name': 'volume-4ea25c27-f920-48df-8102-ad4f98f02af3', 'volume_size': 2, 'snapshot_id': 'f510ce9a-b33b-487c-94ca-1ec555e65dff'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d56e04-816b-40b0-99a1-cf142fb515c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d56e04-816b-40b0-99a1-cf142fb515c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9238c386-8a8a-4b24-9c05-b22cdb1f252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:21 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Volume 4ea25c27-f920-48df-8102-ad4f98f02af3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ea25c27-f920-48df-8102-ad4f98f02af3', 'volume_size': 2, 'snapshot_id': 'f510ce9a-b33b-487c-94ca-1ec555e65dff'} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:21 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 1073741824" returned: 0 in 0.569s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:21 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 Apr 13 17:25:21 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:22 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5" returned: 0 in 0.455s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.543s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-f510ce9a-b33b-487c-94ca-1ec555e65dff-4ea25c27-f920-48df-8102-ad4f98f02af3" by "_create_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030c0762-2e5e-43b9-b9ae-06dd8c691b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a5d67b-0287-4ad2-97a5-2001e29a348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:22 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Volume volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 (17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5): created successfully Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a5d67b-0287-4ad2-97a5-2001e29a348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Flow 'volume_create_manager' (084c0988-287a-4888-bbae-0cd56c23c9d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-f510ce9a-b33b-487c-94ca-1ec555e65dff-4ea25c27-f920-48df-8102-ad4f98f02af3" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Creating volume 4ea25c27-f920-48df-8102-ad4f98f02af3 from snapshot f510ce9a-b33b-487c-94ca-1ec555e65dff {{(pid=81998) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-4ea25c27-f920-48df-8102-ad4f98f02af3" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:22 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-2589dc01-d559-4ea1-b504-47420105a643 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Created volume successfully. Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-4ea25c27-f920-48df-8102-ad4f98f02af3" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] snapshot: f510ce9a-b33b-487c-94ca-1ec555e65dff, volume: 4ea25c27-f920-48df-8102-ad4f98f02af3, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07ff02b-247a-493b-b0d4-22a32a972e92]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:22 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff Apr 13 17:25:22 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Flow 'volume_create_manager' (8fd8a969-ba7f-4c97-9032-752d8070e4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213e1f54-1dfc-4a94-be87-c3a38ad39b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213e1f54-1dfc-4a94-be87-c3a38ad39b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-85451065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed87b77-2adb-4364-89b4-3e776362b4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af67c276b42d493bb8ae8a4841c8f1be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:23Z,use_quota=True,user_id='100d340c0c3740d8ae146fd92d6d6cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff99ffa5-a454-4023-a2b1-cd5651989a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff99ffa5-a454-4023-a2b1-cd5651989a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29261e4e-6259-4c8e-ba19-daf223e52c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29261e4e-6259-4c8e-ba19-daf223e52c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed87b77-2adb-4364-89b4-3e776362b4ea', 'volume_name': 'volume-4ed87b77-2adb-4364-89b4-3e776362b4ea', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb66353b-eef4-4391-ab39-2fd690290cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb66353b-eef4-4391-ab39-2fd690290cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75045227-a42e-4b53-a467-c00a194347b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:22 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Volume 4ed87b77-2adb-4364-89b4-3e776362b4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed87b77-2adb-4364-89b4-3e776362b4ea', 'volume_size': 1} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:22 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff" returned: 0 in 0.539s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e426f3b2-379f-4b9e-aade-a9252006eb6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[210fcb43-4a4b-4c38-a5d0-d2651ea272c5]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:23 devstack sudo[86619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c Apr 13 17:25:23 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:23 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c" returned: 0 in 0.510s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:23 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3 not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:25:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:23 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3 Apr 13 17:25:23 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:23 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-53e8865f-3143-4470-a436-16b5bd38765e tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Terminate volume connection completed successfully. Apr 13 17:25:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-53e8865f-3143-4470-a436-16b5bd38765e tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Deleting attachment 384efb93-89e8-48a9-abf9-3a19af95b5b8. {{(pid=81998) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 17:25:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Acquiring lock "cinder-a3dfd1d1-c762-405f-8da0-4b3628900e59-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "cinder-a3dfd1d1-c762-405f-8da0-4b3628900e59-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Acquiring lock "cinder-quobyte-a3dfd1d1-c762-405f-8da0-4b3628900e59" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "cinder-quobyte-a3dfd1d1-c762-405f-8da0-4b3628900e59" acquired by "delete_volume" :: waited 0.028s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:24 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf5617d-1ac5-46ca-8524-e2cf4f35ddd1]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:24 devstack sudo[86637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59 Apr 13 17:25:24 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:25 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59" returned: 0 in 1.061s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:25 devstack sudo[86643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59 Apr 13 17:25:25 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:25 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3" returned: 0 in 2.514s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:25 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd15ffa3-84bc-45e3-a52a-1e40425a4ef7]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:26 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c Apr 13 17:25:26 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:26 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a3dfd1d1-c762-405f-8da0-4b3628900e59" returned: 0 in 0.599s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "cinder-quobyte-a3dfd1d1-c762-405f-8da0-4b3628900e59" released by "delete_volume" :: held 1.723s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG cinder.quota [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Created reservations ['f1f239a7-268a-4644-8605-e521060fc209', '14e2cb81-2b22-4985-9205-7960a904cce8', '708eecdb-60be-4913-8de5-c3219c31516b', 'cb25a08d-7746-4dc5-a9ca-e875c108dbcc'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:26 devstack sudo[86648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:26 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:26 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c" returned: 0 in 0.656s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3 {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:25:26 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Converted 1024.00 MB image at 406.98 MB/s Apr 13 17:25:26 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3 is being set with open permissions: ugo+rw Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:26 devstack sudo[86653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3 Apr 13 17:25:26 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:26 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.428s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG cinder.manager [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:26 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Deleted volume successfully. Apr 13 17:25:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-1f8cdc4c-d31a-4395-a72b-0c00a0cc06d7 req-1a19c108-96e1-4784-b596-09b3bac6dd3d tempest-ServerBootFromVolumeStableRescueTest-1016900835 None] Lock "cinder-a3dfd1d1-c762-405f-8da0-4b3628900e59-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:27 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3" returned: 0 in 0.478s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-4ea25c27-f920-48df-8102-ad4f98f02af3" released by "_copy_volume_from_snapshot" :: held 4.759s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-f510ce9a-b33b-487c-94ca-1ec555e65dff-4ea25c27-f920-48df-8102-ad4f98f02af3" released by "_create_volume_from_snapshot" :: held 4.785s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.822s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.407s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-85451065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed87b77-2adb-4364-89b4-3e776362b4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af67c276b42d493bb8ae8a4841c8f1be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:23Z,use_quota=True,user_id='100d340c0c3740d8ae146fd92d6d6cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Creating volume 4ed87b77-2adb-4364-89b4-3e776362b4ea {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:25:27 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ed87b77-2adb-4364-89b4-3e776362b4ea 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:27 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ed87b77-2adb-4364-89b4-3e776362b4ea 1073741824 Apr 13 17:25:27 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9238c386-8a8a-4b24-9c05-b22cdb1f252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ea25c27-f920-48df-8102-ad4f98f02af3', 'volume_size': 2, 'snapshot_id': 'f510ce9a-b33b-487c-94ca-1ec555e65dff'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0637a701-52cd-4816-9bba-88107edc9896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:27 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Volume volume-4ea25c27-f920-48df-8102-ad4f98f02af3 (4ea25c27-f920-48df-8102-ad4f98f02af3): created successfully Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0637a701-52cd-4816-9bba-88107edc9896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Flow 'volume_create_manager' (35fc4896-13e2-486f-8b06-45998775e5bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:27 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-9629d329-c110-405e-848c-7fdc5e641fa6 tempest-VolumesSnapshotTestJSON-707237842 None] Created volume successfully. Apr 13 17:25:27 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ed87b77-2adb-4364-89b4-3e776362b4ea 1073741824" returned: 0 in 0.613s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ed87b77-2adb-4364-89b4-3e776362b4ea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:27 devstack sudo[86663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ed87b77-2adb-4364-89b4-3e776362b4ea Apr 13 17:25:27 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-4ea25c27-f920-48df-8102-ad4f98f02af3-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-4ea25c27-f920-48df-8102-ad4f98f02af3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-4ea25c27-f920-48df-8102-ad4f98f02af3" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-4ea25c27-f920-48df-8102-ad4f98f02af3" acquired by "delete_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[65328958-7274-4c01-b462-703ab0d5f2c9]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:28 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ed87b77-2adb-4364-89b4-3e776362b4ea" returned: 0 in 0.457s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.845s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75045227-a42e-4b53-a467-c00a194347b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed87b77-2adb-4364-89b4-3e776362b4ea', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049f6b79-ca47-4a4b-9185-34711b4e63ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:28 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Volume volume-4ed87b77-2adb-4364-89b4-3e776362b4ea (4ed87b77-2adb-4364-89b4-3e776362b4ea): created successfully Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049f6b79-ca47-4a4b-9185-34711b4e63ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:28 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3 Apr 13 17:25:28 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Flow 'volume_create_manager' (8fd8a969-ba7f-4c97-9032-752d8070e4b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:28 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b83fb25c-2855-44e4-8658-5891552e8014 tempest-VolumesListAdminTestJSON-1240577543 None] Created volume successfully. Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Creating offline snapshot 9876ea8e-5b18-4197-b0f5-58a60ec03fd8 of volume 17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[123287e3-68dc-4e1b-a217-8b0afad2f1ae]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:28 devstack sudo[86668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 Apr 13 17:25:28 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:28 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3" returned: 0 in 0.593s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:28 devstack sudo[86686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3 Apr 13 17:25:28 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:28 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5" returned: 0 in 0.635s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:28 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 1G Apr 13 17:25:28 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:29 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ea25c27-f920-48df-8102-ad4f98f02af3" returned: 0 in 0.562s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-4ea25c27-f920-48df-8102-ad4f98f02af3" released by "delete_volume" :: held 1.187s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Created reservations ['2925f0e2-1179-4e08-9cfb-641c143f500d', 'd241b777-5dc6-4176-a106-bbdbb9ce4aa9', '8c5cc481-dd03-4e92-a843-cf667cf08078', '8b9f4383-461a-420e-aad9-d697d42907bf'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:29 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:29 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:29 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 1G" returned: 0 in 0.629s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:29 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 Apr 13 17:25:29 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Flow 'volume_create_manager' (601bc177-e70f-4a93-ae1c-aa3f80117d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53807cc-145e-454d-8a32-bd6960f74794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53807cc-145e-454d-8a32-bd6960f74794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00187159dec44e6801844fcfa7aa8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:30Z,use_quota=True,user_id='99a6fc6286f54b5ca53ca2a0c61a2d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4654ce06-d413-4176-b4e2-2f6e841fabf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4654ce06-d413-4176-b4e2-2f6e841fabf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138507fc-1df7-4b8d-9717-7c3ad03fd174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138507fc-1df7-4b8d-9717-7c3ad03fd174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac', 'volume_name': 'volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460e4ff3-a694-45dd-bc41-18085d993ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460e4ff3-a694-45dd-bc41-18085d993ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee817f25-15dc-42d9-b97a-a4ed0359d10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:29 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Volume 6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac', 'volume_size': 1} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:29 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.459s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:29 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Deleted volume successfully. Apr 13 17:25:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-119d4766-0ff5-4013-af8f-fd464ae3db3f tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-4ea25c27-f920-48df-8102-ad4f98f02af3-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:30 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8" returned: 0 in 0.455s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:30 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 is being set with open permissions: ugo+rw Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:30 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 Apr 13 17:25:30 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-f510ce9a-b33b-487c-94ca-1ec555e65dff-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-f510ce9a-b33b-487c-94ca-1ec555e65dff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-e426f3b2-379f-4b9e-aade-a9252006eb6c" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-e426f3b2-379f-4b9e-aade-a9252006eb6c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-f510ce9a-b33b-487c-94ca-1ec555e65dff" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-f510ce9a-b33b-487c-94ca-1ec555e65dff" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Deleting offline snapshot f510ce9a-b33b-487c-94ca-1ec555e65dff of volume e426f3b2-379f-4b9e-aade-a9252006eb6c {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] snapshot_file for this snap is: volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a4e32d-c750-4b0b-8f97-c04f71ffdd6d]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:30 devstack sudo[86726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff Apr 13 17:25:30 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:30 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8" returned: 0 in 0.473s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:30 devstack sudo[86729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.info Apr 13 17:25:30 devstack sudo[86729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:30 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff" returned: 0 in 0.486s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e426f3b2-379f-4b9e-aade-a9252006eb6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[062aa9e7-45b8-4364-95e0-403ca654949c]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:30 devstack sudo[86729]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.info" returned: 0 in 0.454s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:30 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.info is being set with open permissions: ugo+rw Apr 13 17:25:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:30 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c Apr 13 17:25:30 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:30 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.info Apr 13 17:25:30 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:31 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.info" returned: 0 in 0.457s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.210s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.755s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00187159dec44e6801844fcfa7aa8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:30Z,use_quota=True,user_id='99a6fc6286f54b5ca53ca2a0c61a2d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Creating volume 6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:25:31 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:25:31 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c" returned: 0 in 0.575s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:31 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac 1073741824 Apr 13 17:25:31 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:31 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-54f3d036-0c68-4d25-bd94-3a158746b404 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Create snapshot completed successfully Apr 13 17:25:31 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff Apr 13 17:25:31 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Acquiring lock "cinder-9876ea8e-5b18-4197-b0f5-58a60ec03fd8-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "cinder-9876ea8e-5b18-4197-b0f5-58a60ec03fd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Acquiring lock "cinder-quobyte-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "cinder-quobyte-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Acquiring lock "cinder-quobyte-9876ea8e-5b18-4197-b0f5-58a60ec03fd8" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "cinder-quobyte-9876ea8e-5b18-4197-b0f5-58a60ec03fd8" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Deleting offline snapshot 9876ea8e-5b18-4197-b0f5-58a60ec03fd8 of volume 17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] snapshot_file for this snap is: volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[591641b6-7505-4e7f-9e44-b24fc9fd0dbf]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:32 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac 1073741824" returned: 0 in 0.607s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:32 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff" returned: 0 in 0.634s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:32 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac Apr 13 17:25:32 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:32 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 Apr 13 17:25:32 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:32 devstack sudo[86791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff Apr 13 17:25:32 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:32 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac" returned: 0 in 0.473s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee817f25-15dc-42d9-b97a-a4ed0359d10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8ea1c0-fd25-45b4-ba4f-24f40b8ec0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:32 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Volume volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac (6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac): created successfully Apr 13 17:25:32 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8ea1c0-fd25-45b4-ba4f-24f40b8ec0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Flow 'volume_create_manager' (601bc177-e70f-4a93-ae1c-aa3f80117d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c.f510ce9a-b33b-487c-94ca-1ec555e65dff" returned: 0 in 0.497s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:32 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-0ee98581-7d02-471b-a857-1c9b735b133c tempest-VolumesListAdminTestJSON-167523017 None] Created volume successfully. Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-f510ce9a-b33b-487c-94ca-1ec555e65dff" released by "_delete_snapshot" :: held 2.249s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-e426f3b2-379f-4b9e-aade-a9252006eb6c" released by "delete_snapshot" :: held 2.265s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:32 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8" returned: 0 in 0.602s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8322de3c-4140-4e17-bd78-0a1583a41cc7]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Created reservations ['0a4a2c13-4d01-4e12-8d7d-4fc0e53ca0ad', '3e033c10-3522-42e7-a39e-4ff4ec2e17e7', 'cfe22ac9-7664-4747-922e-f45dffd35d0e', 'd49ae985-0922-43f8-b9f7-64e5d4ca01e2'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:32 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Delete snapshot completed successfully. Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-aaba043d-9797-450e-a077-3849fa957b66 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-f510ce9a-b33b-487c-94ca-1ec555e65dff-delete_snapshot" released by "delete_snapshot" :: held 2.400s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:32 devstack sudo[86799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 Apr 13 17:25:32 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Acquiring lock "cinder-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Lock "cinder-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Acquiring lock "cinder-quobyte-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Lock "cinder-quobyte-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac" acquired by "delete_volume" :: waited 0.016s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0768a4-7e57-4cab-bb4a-b173284a1f91]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "cinder-4ed87b77-2adb-4364-89b4-3e776362b4ea-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "cinder-4ed87b77-2adb-4364-89b4-3e776362b4ea-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "cinder-quobyte-4ed87b77-2adb-4364-89b4-3e776362b4ea" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "cinder-quobyte-4ed87b77-2adb-4364-89b4-3e776362b4ea" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b004e-1869-4e4b-b9ec-be1b718aa855]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ed87b77-2adb-4364-89b4-3e776362b4ea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:32 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac Apr 13 17:25:32 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:33 devstack sudo[86803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ed87b77-2adb-4364-89b4-3e776362b4ea Apr 13 17:25:33 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:33 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5" returned: 0 in 0.554s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:33 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 Apr 13 17:25:33 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:33 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac" returned: 0 in 0.514s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:33 devstack sudo[86813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac Apr 13 17:25:33 devstack sudo[86813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:33 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ed87b77-2adb-4364-89b4-3e776362b4ea" returned: 0 in 0.583s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ed87b77-2adb-4364-89b4-3e776362b4ea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_service.periodic_task [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:33 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ed87b77-2adb-4364-89b4-3e776362b4ea Apr 13 17:25:33 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-e426f3b2-379f-4b9e-aade-a9252006eb6c-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-e426f3b2-379f-4b9e-aade-a9252006eb6c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-e426f3b2-379f-4b9e-aade-a9252006eb6c" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:33 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:33 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-e426f3b2-379f-4b9e-aade-a9252006eb6c" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9593c81d-414a-40cc-a3ca-05f462f21f90]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:33 devstack sudo[86825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c Apr 13 17:25:33 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:33 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8" returned: 0 in 0.714s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:33 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8 Apr 13 17:25:33 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:34 devstack sudo[86813]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac" returned: 0 in 0.712s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Lock "cinder-quobyte-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac" released by "delete_volume" :: held 1.260s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Created reservations ['c9b44ab1-4fae-471e-b98e-7dcfd40cbbf8', 'f08e5e98-b245-47ae-a850-651016216b0c', '72c88cc3-353b-46fe-a5e5-7563e87410d1', '00ca777a-d889-4ded-81ba-08117cace6d1'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:34 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4ed87b77-2adb-4364-89b4-3e776362b4ea" returned: 0 in 0.692s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "cinder-quobyte-4ed87b77-2adb-4364-89b4-3e776362b4ea" released by "delete_volume" :: held 1.318s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:34 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:34 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Created reservations ['04c9b1ce-19a4-4596-8ac1-fcc3ca346fab', 'c04d5b90-e97c-4afa-9702-4df46b93a1ea', '18d8415c-da85-4342-8db1-970a6e436cf7', 'adc3774b-38b7-48a1-a1fd-2ea45c930b0c'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:34 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.779s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:34 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c" returned: 0 in 0.716s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:34 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:34 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:34 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c Apr 13 17:25:34 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:34 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5.9876ea8e-5b18-4197-b0f5-58a60ec03fd8" returned: 0 in 0.851s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "cinder-quobyte-9876ea8e-5b18-4197-b0f5-58a60ec03fd8" released by "_delete_snapshot" :: held 2.795s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "cinder-quobyte-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5" released by "delete_snapshot" :: held 2.810s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:34 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.651s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Created reservations ['6b98d307-0919-45f8-b344-149a290a9541', 'b1f7f174-c7f6-4ba3-b9d4-81ca5db85368', '187f6d7c-3342-43fc-af4f-fdc432fd9ba9', '1d6b8a92-00dd-4075-873f-f685dbaabfe4'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:34 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Deleted volume successfully. Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-7758a01e-625e-4cb6-be56-b600944784ee tempest-VolumesListAdminTestJSON-167523017 None] Lock "cinder-6bfc61e7-8db8-452a-91f0-b1e8c9ad25ac-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:34 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Delete snapshot completed successfully. Apr 13 17:25:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d26e4578-d107-4493-a3e9-977ee77af4eb tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "cinder-9876ea8e-5b18-4197-b0f5-58a60ec03fd8-delete_snapshot" released by "delete_snapshot" :: held 2.964s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:35 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.570s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:35 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Deleted volume successfully. Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-cf6ca8ee-b236-4d92-9e6f-7405e3d21222 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "cinder-4ed87b77-2adb-4364-89b4-3e776362b4ea-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "cinder-5898987f-099f-48ec-a491-d60f7f9ee857-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:35 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Lock "cinder-5898987f-099f-48ec-a491-d60f7f9ee857-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e426f3b2-379f-4b9e-aade-a9252006eb6c" returned: 0 in 0.765s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-e426f3b2-379f-4b9e-aade-a9252006eb6c" released by "delete_volume" :: held 1.523s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Acquiring lock "cinder-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Created reservations ['2de37a92-c1eb-48a4-a197-7a06110da573', '23edfd9c-2538-472d-959c-f8021d598eda', 'a3e5407d-cadf-45a4-89d4-6a9ced98abba', '10ccc9de-8e97-40b4-806b-326dd18367f1'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "cinder-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "cinder-quobyte-5898987f-099f-48ec-a491-d60f7f9ee857" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:35 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:35 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Lock "cinder-quobyte-5898987f-099f-48ec-a491-d60f7f9ee857" acquired by "delete_volume" :: waited 0.033s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Acquiring lock "cinder-quobyte-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[144bfed6-ace1-4c2a-a5ee-ce0dca6048d7]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5898987f-099f-48ec-a491-d60f7f9ee857 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "cinder-quobyte-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5" acquired by "delete_volume" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a60f88a-fdf4-4010-ad35-122f220b935e]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:35 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5898987f-099f-48ec-a491-d60f7f9ee857 Apr 13 17:25:35 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:35 devstack sudo[86850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 Apr 13 17:25:35 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:35 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.567s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:35 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Deleted volume successfully. Apr 13 17:25:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-afaa9de6-929f-4e69-8555-670c5401c27b tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-e426f3b2-379f-4b9e-aade-a9252006eb6c-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:36 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5898987f-099f-48ec-a491-d60f7f9ee857" returned: 0 in 0.626s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5898987f-099f-48ec-a491-d60f7f9ee857 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:36 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5" returned: 0 in 0.604s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:36 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5898987f-099f-48ec-a491-d60f7f9ee857 Apr 13 17:25:36 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:36 devstack sudo[86863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5 Apr 13 17:25:36 devstack sudo[86863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Flow 'volume_create_manager' (28889b07-2ccc-4929-9553-c23913e5ca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ad4c0f-381a-47bb-a533-79c938ed2a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ad4c0f-381a-47bb-a533-79c938ed2a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-446215561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a05433-27b8-4628-bffa-497beedfd018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0b1fbb05de44b890a14eb5823cd6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:36Z,use_quota=True,user_id='2d1b8de3caf14a00b581722a3e9df9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7ed00d-a7a2-440d-a61e-e773b9180974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7ed00d-a7a2-440d-a61e-e773b9180974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ea0019-cd80-418a-bc31-8439c2885866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ea0019-cd80-418a-bc31-8439c2885866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a05433-27b8-4628-bffa-497beedfd018', 'volume_name': 'volume-01a05433-27b8-4628-bffa-497beedfd018', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3714d476-3edd-459a-ae54-6c0be0e7ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3714d476-3edd-459a-ae54-6c0be0e7ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eddb0ff-fee2-4aba-abf0-3964cdb8caa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:36 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Volume 01a05433-27b8-4628-bffa-497beedfd018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a05433-27b8-4628-bffa-497beedfd018', 'volume_size': 1} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-446215561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a05433-27b8-4628-bffa-497beedfd018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0b1fbb05de44b890a14eb5823cd6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:36Z,use_quota=True,user_id='2d1b8de3caf14a00b581722a3e9df9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Creating volume 01a05433-27b8-4628-bffa-497beedfd018 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:25:36 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:36 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 1073741824 Apr 13 17:25:36 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:36 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5898987f-099f-48ec-a491-d60f7f9ee857" returned: 0 in 0.539s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Lock "cinder-quobyte-5898987f-099f-48ec-a491-d60f7f9ee857" released by "delete_volume" :: held 1.187s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Created reservations ['e762820d-7920-4c35-87d9-37ea1d23c5de', '9fcabc12-a7d7-4b7f-9190-aeb5b878a6f0', '05bd0e2d-f180-4f01-bca9-0114a59e1f65', 'ea60712c-4705-4984-a63b-66bf285b4217'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:36 devstack sudo[86863]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5" returned: 0 in 0.614s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "cinder-quobyte-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5" released by "delete_volume" :: held 1.258s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:36 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:36 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Created reservations ['ff51321f-2c3e-4fc1-a771-bc93f992481a', '4c6cf339-9fc1-454a-b5c9-b4e49dd0cf2c', '4720c86e-3a2d-49b9-bcca-1c241a72f3f5', '4b019975-442c-4be2-9619-9ff055dc9b63'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:36 devstack sudo[86875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:36 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:36 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 1073741824" returned: 0 in 0.638s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:37 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 Apr 13 17:25:37 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:37 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.552s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:37 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Deleted volume successfully. Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d489eef4-bda4-47ef-8d04-ca6d5ab7a1cd tempest-VolumesListAdminTestJSON-1240577543 None] Lock "cinder-5898987f-099f-48ec-a491-d60f7f9ee857-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:37 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018" returned: 0 in 0.460s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:37 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eddb0ff-fee2-4aba-abf0-3964cdb8caa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a05433-27b8-4628-bffa-497beedfd018', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b7806f-c16c-4aad-8772-e68573d4d163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.651s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:37 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Volume volume-01a05433-27b8-4628-bffa-497beedfd018 (01a05433-27b8-4628-bffa-497beedfd018): created successfully Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b7806f-c16c-4aad-8772-e68573d4d163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Flow 'volume_create_manager' (28889b07-2ccc-4929-9553-c23913e5ca56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:37 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Deleted volume successfully. Apr 13 17:25:37 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-4e9aae9d-2703-4f0c-b04f-f5410b1d4444 tempest-VolumesSnapshotTestJSON-707237842 None] Created volume successfully. Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "cinder-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-82a6cdc5-f333-47b4-b909-362e58e02511 tempest-VolumeSnapshotQuotasNegativeTestJSON-286887605 None] Lock "cinder-17d5898a-5a1a-4dbe-a8c6-54c1ddfa57f5-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "cinder-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "cinder-quobyte-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "cinder-quobyte-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da4d057-b8d2-4620-aa18-0996ca2e0383]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:37 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc Apr 13 17:25:37 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:38 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc" returned: 0 in 0.581s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:38 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc Apr 13 17:25:38 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:38 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc" returned: 0 in 0.555s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "cinder-quobyte-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc" released by "delete_volume" :: held 1.178s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] Creating offline snapshot a1e6f43f-03c7-42bc-8c36-954b9a68e908 of volume 01a05433-27b8-4628-bffa-497beedfd018 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2b0f9e-2dcd-4a7f-8ea8-95e2c0edf4da]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Created reservations ['82c2d4ff-b11c-47b7-b86f-f2d776ec538e', '639f8239-3b82-4f64-a2f2-d93a80cd8e33', 'a5ecca63-441f-4481-aaa0-65b3dd204d04', 'ac56fb58-5fec-42eb-804f-0ef2b4974a84'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:38 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 Apr 13 17:25:38 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:38 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:38 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:39 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.526s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:39 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:39 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Deleted volume successfully. Apr 13 17:25:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-65c0e6f5-3b0a-438f-9bf2-28bb572f2a42 tempest-VolumesListAdminTestJSON-1240577543 None] Lock "cinder-8dacd1d3-7755-4cd0-bbd6-d3165b0651cc-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:39 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018" returned: 0 in 0.668s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:39 devstack sudo[86899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 1G Apr 13 17:25:39 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:40 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 1G" returned: 0 in 0.678s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a05433-27b8-4628-bffa-497beedfd018 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:40 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a05433-27b8-4628-bffa-497beedfd018 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 Apr 13 17:25:40 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:40 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a05433-27b8-4628-bffa-497beedfd018 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908" returned: 0 in 0.585s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:40 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 is being set with open permissions: ugo+rw Apr 13 17:25:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:40 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 Apr 13 17:25:40 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:41 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908" returned: 0 in 0.627s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:41 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.info Apr 13 17:25:41 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:41 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.info" returned: 0 in 0.563s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:41 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.info is being set with open permissions: ugo+rw Apr 13 17:25:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:41 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.info Apr 13 17:25:41 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:42 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.info" returned: 0 in 0.487s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.725s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:42 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d6d5949e-f06b-411c-a850-37c8c15432fe tempest-VolumesSnapshotTestJSON-707237842 None] Create snapshot completed successfully Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Flow 'volume_create_manager' (8b9aa85e-b2a3-4999-ba46-47c4ba64c656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11baca69-a1b5-42cb-a2ad-ed17cdbf0757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11baca69-a1b5-42cb-a2ad-ed17cdbf0757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-317670582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa5aaf8-2279-4897-934b-6996e5fcb1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0b1fbb05de44b890a14eb5823cd6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1e6f43f-03c7-42bc-8c36-954b9a68e908,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:43Z,use_quota=True,user_id='2d1b8de3caf14a00b581722a3e9df9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8b859c-48d7-4379-b1d3-69f7223640c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8b859c-48d7-4379-b1d3-69f7223640c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364cf02a-25b7-46fa-840d-2a4f39b7d91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364cf02a-25b7-46fa-840d-2a4f39b7d91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'efa5aaf8-2279-4897-934b-6996e5fcb1ba', 'volume_name': 'volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba', 'volume_size': 1, 'snapshot_id': 'a1e6f43f-03c7-42bc-8c36-954b9a68e908'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d356d72f-b028-4009-9d84-93c644ccb18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d356d72f-b028-4009-9d84-93c644ccb18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5897cb-6db9-429a-90d9-275707aebe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:43 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Volume efa5aaf8-2279-4897-934b-6996e5fcb1ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba', 'volume_size': 1, 'snapshot_id': 'a1e6f43f-03c7-42bc-8c36-954b9a68e908'} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-a1e6f43f-03c7-42bc-8c36-954b9a68e908-efa5aaf8-2279-4897-934b-6996e5fcb1ba" by "_create_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-a1e6f43f-03c7-42bc-8c36-954b9a68e908-efa5aaf8-2279-4897-934b-6996e5fcb1ba" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Creating volume efa5aaf8-2279-4897-934b-6996e5fcb1ba from snapshot a1e6f43f-03c7-42bc-8c36-954b9a68e908 {{(pid=81998) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-efa5aaf8-2279-4897-934b-6996e5fcb1ba" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-efa5aaf8-2279-4897-934b-6996e5fcb1ba" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] snapshot: a1e6f43f-03c7-42bc-8c36-954b9a68e908, volume: efa5aaf8-2279-4897-934b-6996e5fcb1ba, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba319313-9b6d-4448-a3d8-2e309a01e16d]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:43 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 Apr 13 17:25:43 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:44 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908" returned: 0 in 0.708s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a05433-27b8-4628-bffa-497beedfd018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:25:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:25:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:25:44 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba5a2d7-a074-4ba5-a574-a5574397d831]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:44 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 Apr 13 17:25:44 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:44 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018" returned: 0 in 0.623s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:44 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:25:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:44 devstack sudo[86928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba Apr 13 17:25:44 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:47 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba" returned: 0 in 3.125s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:48 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e951e9b6-3c87-481f-99b8-79fd417e5ed1]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:48 devstack sudo[86943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 Apr 13 17:25:48 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:49 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018" returned: 0 in 1.059s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018, size 1024.00 MB, duration 3.13 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:25:49 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Converted 1024.00 MB image at 327.49 MB/s Apr 13 17:25:49 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba is being set with open permissions: ugo+rw Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:49 devstack sudo[86948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba Apr 13 17:25:49 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:49 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba" returned: 0 in 0.571s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-efa5aaf8-2279-4897-934b-6996e5fcb1ba" released by "_copy_volume_from_snapshot" :: held 6.164s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-a1e6f43f-03c7-42bc-8c36-954b9a68e908-efa5aaf8-2279-4897-934b-6996e5fcb1ba" released by "_create_volume_from_snapshot" :: held 6.198s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.207s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:UPDATE=154,cinder:DELETE=17,cinder:SELECT=153,cinder:INSERT=40 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=137,cinder:UPDATE=190,cinder:INSERT=40,cinder:DELETE=13 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5897cb-6db9-429a-90d9-275707aebe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba', 'volume_size': 1, 'snapshot_id': 'a1e6f43f-03c7-42bc-8c36-954b9a68e908'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f9e6fb-8f6d-482b-8b5c-b34c2e037967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:49 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Volume volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba (efa5aaf8-2279-4897-934b-6996e5fcb1ba): created successfully Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f9e6fb-8f6d-482b-8b5c-b34c2e037967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Flow 'volume_create_manager' (8b9aa85e-b2a3-4999-ba46-47c4ba64c656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:49 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-98db2f0b-033c-44d9-b8e1-ed0d07b55d6c tempest-VolumesSnapshotTestJSON-707237842 None] Created volume successfully. Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-efa5aaf8-2279-4897-934b-6996e5fcb1ba-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-efa5aaf8-2279-4897-934b-6996e5fcb1ba-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-efa5aaf8-2279-4897-934b-6996e5fcb1ba" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-efa5aaf8-2279-4897-934b-6996e5fcb1ba" acquired by "delete_volume" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:50 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1826db0-2510-4f4f-bdd9-c8e024fbfb7c]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:50 devstack sudo[86954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba Apr 13 17:25:50 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:50 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba" returned: 0 in 0.669s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:50 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba Apr 13 17:25:50 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Flow 'volume_create_manager' (b2f1d105-020c-4a47-b48b-7136471ca9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f85b177-3d43-4817-929f-8eb06a14e177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f85b177-3d43-4817-929f-8eb06a14e177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1601696667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16307f07-a733-4be4-8d4b-8268979b046a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df245c71e83f4dca9b74c03f3283dc22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:51Z,use_quota=True,user_id='ba35f14b43c847c98c0d9e83f942d678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590a1845-5369-4931-ab4f-3c2a9568006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590a1845-5369-4931-ab4f-3c2a9568006e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ce55bc-d585-4e0e-9abd-dd1bcb5a3335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ce55bc-d585-4e0e-9abd-dd1bcb5a3335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16307f07-a733-4be4-8d4b-8268979b046a', 'volume_name': 'volume-16307f07-a733-4be4-8d4b-8268979b046a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c558b2-762b-4644-935a-969efa55ee91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c558b2-762b-4644-935a-969efa55ee91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2166a3cf-1753-46e9-9295-ecf7243a122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:51 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Volume 16307f07-a733-4be4-8d4b-8268979b046a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16307f07-a733-4be4-8d4b-8268979b046a', 'volume_size': 1} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1601696667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16307f07-a733-4be4-8d4b-8268979b046a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df245c71e83f4dca9b74c03f3283dc22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:25:51Z,use_quota=True,user_id='ba35f14b43c847c98c0d9e83f942d678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Creating volume 16307f07-a733-4be4-8d4b-8268979b046a {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:25:51 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-16307f07-a733-4be4-8d4b-8268979b046a 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:51 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa5aaf8-2279-4897-934b-6996e5fcb1ba" returned: 0 in 0.530s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-efa5aaf8-2279-4897-934b-6996e5fcb1ba" released by "delete_volume" :: held 1.234s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:51 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-16307f07-a733-4be4-8d4b-8268979b046a 1073741824 Apr 13 17:25:51 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Created reservations ['0df52166-7992-421d-a207-a474ecd5bfa5', 'b85b039a-32d1-4785-adbd-e70067b0c804', '5171d223-7d41-490f-acad-868657310d4a', 'e7263282-933e-4543-84e6-fa933ad2d5fa'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:51 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:51 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:51 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-16307f07-a733-4be4-8d4b-8268979b046a 1073741824" returned: 0 in 0.620s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:51 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-16307f07-a733-4be4-8d4b-8268979b046a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.521s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:51 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Deleted volume successfully. Apr 13 17:25:51 devstack sudo[86972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-16307f07-a733-4be4-8d4b-8268979b046a Apr 13 17:25:51 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f19531ba-50f2-4e60-81fb-b7e04f9c9a57 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-efa5aaf8-2279-4897-934b-6996e5fcb1ba-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-a1e6f43f-03c7-42bc-8c36-954b9a68e908-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-a1e6f43f-03c7-42bc-8c36-954b9a68e908-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-01a05433-27b8-4628-bffa-497beedfd018" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-01a05433-27b8-4628-bffa-497beedfd018" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-a1e6f43f-03c7-42bc-8c36-954b9a68e908" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-a1e6f43f-03c7-42bc-8c36-954b9a68e908" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Deleting offline snapshot a1e6f43f-03c7-42bc-8c36-954b9a68e908 of volume 01a05433-27b8-4628-bffa-497beedfd018 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] snapshot_file for this snap is: volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a899de8-76e1-4fc9-a5b5-c5b130dac3e8]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:52 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 Apr 13 17:25:52 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:52 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-16307f07-a733-4be4-8d4b-8268979b046a" returned: 0 in 0.546s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2166a3cf-1753-46e9-9295-ecf7243a122f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16307f07-a733-4be4-8d4b-8268979b046a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cb7ce4-8cc3-4d05-931b-b6506082086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:25:52 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Volume volume-16307f07-a733-4be4-8d4b-8268979b046a (16307f07-a733-4be4-8d4b-8268979b046a): created successfully Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cb7ce4-8cc3-4d05-931b-b6506082086c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Flow 'volume_create_manager' (b2f1d105-020c-4a47-b48b-7136471ca9fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:25:52 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e6ab3346-0e45-4092-8f9d-493c9a0f13b4 tempest-AbsoluteLimitsTests-2118650755 None] Created volume successfully. Apr 13 17:25:52 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908" returned: 0 in 0.593s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a05433-27b8-4628-bffa-497beedfd018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5a8a6a-b270-433e-8130-19f2712dcf81]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:53 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 Apr 13 17:25:53 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Acquiring lock "cinder-16307f07-a733-4be4-8d4b-8268979b046a-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Lock "cinder-16307f07-a733-4be4-8d4b-8268979b046a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Acquiring lock "cinder-quobyte-16307f07-a733-4be4-8d4b-8268979b046a" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Lock "cinder-quobyte-16307f07-a733-4be4-8d4b-8268979b046a" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:53 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f38ad3d-cb12-4b62-ac2c-2e7d2b7914cf]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-16307f07-a733-4be4-8d4b-8268979b046a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:53 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018" returned: 0 in 0.702s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:53 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-16307f07-a733-4be4-8d4b-8268979b046a Apr 13 17:25:53 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:53 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 Apr 13 17:25:53 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:54 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-16307f07-a733-4be4-8d4b-8268979b046a" returned: 0 in 0.596s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-16307f07-a733-4be4-8d4b-8268979b046a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:54 devstack sudo[86996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-16307f07-a733-4be4-8d4b-8268979b046a Apr 13 17:25:54 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:54 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908" returned: 0 in 0.638s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:54 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908 Apr 13 17:25:54 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:54 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-16307f07-a733-4be4-8d4b-8268979b046a" returned: 0 in 0.541s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Lock "cinder-quobyte-16307f07-a733-4be4-8d4b-8268979b046a" released by "delete_volume" :: held 1.162s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Created reservations ['e1bf282f-b9b9-4446-8f53-474682cb337c', '330a58f9-d272-4c3b-b24e-9f451679a6a5', '9073d78d-8779-4e6d-b025-3ac2e89da146', 'bf23552a-045a-4ecb-8a9e-cde42a982381'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:54 devstack sudo[87002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:54 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:54 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018.a1e6f43f-03c7-42bc-8c36-954b9a68e908" returned: 0 in 0.607s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-a1e6f43f-03c7-42bc-8c36-954b9a68e908" released by "_delete_snapshot" :: held 2.665s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-01a05433-27b8-4628-bffa-497beedfd018" released by "delete_snapshot" :: held 2.686s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Created reservations ['1f423f91-5ba6-4502-9489-bb2319d4a8f6', 'fb4c0f85-1bcd-44e4-ae42-0b59956f239d', 'c812040f-8051-44fb-b97b-4d5c1cf42a57', 'cbb20505-dd1b-4c9a-9305-c4be7f9cf62d'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:54 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Delete snapshot completed successfully. Apr 13 17:25:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b89e1b90-c07d-4b3f-9122-e5dab78ba614 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-a1e6f43f-03c7-42bc-8c36-954b9a68e908-delete_snapshot" released by "delete_snapshot" :: held 2.778s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:55 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.560s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:55 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:55 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Deleted volume successfully. Apr 13 17:25:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a1589a28-8105-4379-91ab-3fa4135487a5 tempest-AbsoluteLimitsTests-2118650755 None] Lock "cinder-16307f07-a733-4be4-8d4b-8268979b046a-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-01a05433-27b8-4628-bffa-497beedfd018-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-01a05433-27b8-4628-bffa-497beedfd018-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-01a05433-27b8-4628-bffa-497beedfd018" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-01a05433-27b8-4628-bffa-497beedfd018" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:55 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9a8a95-2f9d-4087-a7a7-3dd030a45135]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:55 devstack sudo[87006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 Apr 13 17:25:55 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:56 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018" returned: 0 in 0.720s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:56 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018 Apr 13 17:25:56 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:56 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-01a05433-27b8-4628-bffa-497beedfd018" returned: 0 in 0.569s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:56 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-01a05433-27b8-4628-bffa-497beedfd018" released by "delete_volume" :: held 1.348s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:56 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Created reservations ['cfb68696-5f39-42c2-a61b-1b92c063f288', 'ef6330c1-35ab-4b27-8c7b-74c3c8f97a48', 'f1188546-0934-4ec3-90bc-30a02c3003bc', '0dbcd543-2998-4100-9ec8-e757a6ff9254'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:57 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:57 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:57 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.628s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:57 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Deleted volume successfully. Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-14f664f4-407c-4b1c-ac76-511d97deb764 tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-01a05433-27b8-4628-bffa-497beedfd018-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-e30789ce-b0c2-458f-93a1-eb6260f4856c-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-e30789ce-b0c2-458f-93a1-eb6260f4856c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "cinder-quobyte-e30789ce-b0c2-458f-93a1-eb6260f4856c" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-e30789ce-b0c2-458f-93a1-eb6260f4856c" acquired by "delete_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2841d6f4-f52a-4912-b459-e56091de76e5]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:25:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:57 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c Apr 13 17:25:57 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:58 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c" returned: 0 in 0.572s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:58 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c Apr 13 17:25:58 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:59 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e30789ce-b0c2-458f-93a1-eb6260f4856c" returned: 0 in 0.727s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-quobyte-e30789ce-b0c2-458f-93a1-eb6260f4856c" released by "delete_volume" :: held 1.341s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:25:59 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Created reservations ['a6b4d3d6-cdcd-4678-93fe-0a12dd076332', '9fd025e9-1177-463d-80aa-9a230b832853', '0f2534fc-1ee8-465d-a83e-68e0ae374798', '5f3baa8e-b791-4aa0-99e5-8866149c4be8'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:25:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:25:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:25:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:25:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:25:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:25:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:25:59 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:25:59 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:25:59 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 13 17:25:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.513s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:25:59 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:25:59 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Deleted volume successfully. Apr 13 17:25:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c8ce431c-13bf-43ac-962c-9d2f65c90f3c tempest-VolumesSnapshotTestJSON-707237842 None] Lock "cinder-e30789ce-b0c2-458f-93a1-eb6260f4856c-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Flow 'volume_create_manager' (227c1392-487b-4e2a-a8bf-c6907a461f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de2fc11-1d46-46b9-9f2d-f5aa16411871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de2fc11-1d46-46b9-9f2d-f5aa16411871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-86122993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d13cb4-037a-427a-ba99-e32c23d5c19a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5a0c2f1cc14f2394b880f5c595b760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:00Z,use_quota=True,user_id='86855a2632bd4b37b7fd9b0e0fab84d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f902c305-5879-4383-88c6-c51e7f9884fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f902c305-5879-4383-88c6-c51e7f9884fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b3e4ba-47da-4791-80d2-00042f6cf67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b3e4ba-47da-4791-80d2-00042f6cf67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d13cb4-037a-427a-ba99-e32c23d5c19a', 'volume_name': 'volume-60d13cb4-037a-427a-ba99-e32c23d5c19a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3833d8-ff83-4adf-a4bb-4fbc48ec7fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3833d8-ff83-4adf-a4bb-4fbc48ec7fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e52650-9749-4405-96ac-53b9b02571f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:00 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Volume 60d13cb4-037a-427a-ba99-e32c23d5c19a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d13cb4-037a-427a-ba99-e32c23d5c19a', 'volume_size': 1} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-86122993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d13cb4-037a-427a-ba99-e32c23d5c19a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5a0c2f1cc14f2394b880f5c595b760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:00Z,use_quota=True,user_id='86855a2632bd4b37b7fd9b0e0fab84d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Creating volume 60d13cb4-037a-427a-ba99-e32c23d5c19a {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:00 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:00 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a 1073741824 Apr 13 17:26:00 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:00 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a 1073741824" returned: 0 in 0.681s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:00 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a Apr 13 17:26:00 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:01 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a" returned: 0 in 0.561s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e52650-9749-4405-96ac-53b9b02571f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d13cb4-037a-427a-ba99-e32c23d5c19a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41ba2ff-4fee-4e39-aee8-57eaa30dd643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:01 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Volume volume-60d13cb4-037a-427a-ba99-e32c23d5c19a (60d13cb4-037a-427a-ba99-e32c23d5c19a): created successfully Apr 13 17:26:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41ba2ff-4fee-4e39-aee8-57eaa30dd643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Flow 'volume_create_manager' (227c1392-487b-4e2a-a8bf-c6907a461f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:01 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b7b875b4-5c64-44e1-a1ad-4511ad7fbc1c tempest-VolumesDeleteCascade-1058011805 None] Created volume successfully. Apr 13 17:26:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] Creating offline snapshot 961a8f94-2884-415d-a234-eaf0ab91b6b4 of volume 60d13cb4-037a-427a-ba99-e32c23d5c19a {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:26:02 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0df79e7-5280-439e-b869-9940a8183a8e]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:02 devstack sudo[87086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a Apr 13 17:26:02 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:03 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a" returned: 0 in 0.531s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:03 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 1G Apr 13 17:26:03 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:03 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 1G" returned: 0 in 0.629s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d13cb4-037a-427a-ba99-e32c23d5c19a -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:03 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d13cb4-037a-427a-ba99-e32c23d5c19a -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 Apr 13 17:26:03 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:04 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d13cb4-037a-427a-ba99-e32c23d5c19a -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4" returned: 0 in 0.516s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:04 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 is being set with open permissions: ugo+rw Apr 13 17:26:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:04 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 Apr 13 17:26:04 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:04 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4" returned: 0 in 0.671s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:05 devstack sudo[87108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.info Apr 13 17:26:05 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Flow 'volume_create_manager' (5ce32f22-f635-4134-a014-a983554c7e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a2a58a-d765-4bc3-9837-2493e8bbd20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a2a58a-d765-4bc3-9837-2493e8bbd20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-280330060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24272bea-1b60-451e-8e29-ab64504503c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6589efcf707449f893b521e44db798ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:05Z,use_quota=True,user_id='8cc01dea9b454aaf890ce145bcd6d5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8ad325-76f4-495b-9bbe-c19c425a335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8ad325-76f4-495b-9bbe-c19c425a335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe168ed-8f10-43fd-aaaa-a16d823ef2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe168ed-8f10-43fd-aaaa-a16d823ef2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24272bea-1b60-451e-8e29-ab64504503c6', 'volume_name': 'volume-24272bea-1b60-451e-8e29-ab64504503c6', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaeeca99-8967-4a6f-a096-fa6e055aa249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaeeca99-8967-4a6f-a096-fa6e055aa249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c04921-9c7a-45b2-9ed9-d8e8d15876ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Volume 24272bea-1b60-451e-8e29-ab64504503c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24272bea-1b60-451e-8e29-ab64504503c6', 'volume_size': 1} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Flow 'volume_create_manager' (95829304-77bd-434e-a87b-1f426ac58205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4e6ad0-2cd3-49f4-b449-9fb0916c3185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4e6ad0-2cd3-49f4-b449-9fb0916c3185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-100624324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20f11bf-76ae-462c-9da0-c47babd7d5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6589efcf707449f893b521e44db798ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:05Z,use_quota=True,user_id='8cc01dea9b454aaf890ce145bcd6d5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7cc524-67c6-452e-bcc1-899db195af75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7cc524-67c6-452e-bcc1-899db195af75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02918a19-0485-498e-a4d0-ac905202c30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02918a19-0485-498e-a4d0-ac905202c30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20f11bf-76ae-462c-9da0-c47babd7d5e2', 'volume_name': 'volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297d9b58-5e1f-489e-9760-ebd50addad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297d9b58-5e1f-489e-9760-ebd50addad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f498a70-59e2-4348-a2e3-6def0eb6462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Volume b20f11bf-76ae-462c-9da0-c47babd7d5e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2', 'volume_size': 1} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Flow 'volume_create_manager' (ee2aaadd-2e94-4560-aa47-bbb2061d3791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783e7f16-d33e-4a89-846c-c4c36bad9bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783e7f16-d33e-4a89-846c-c4c36bad9bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1821273767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce61548-c8b0-4cee-b8d6-6af5568b66af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6589efcf707449f893b521e44db798ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:06Z,use_quota=True,user_id='8cc01dea9b454aaf890ce145bcd6d5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6538045-4db8-4c7d-9786-a8707fe75aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6538045-4db8-4c7d-9786-a8707fe75aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d67a13-a46d-4775-aacd-9afa7c2075df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d67a13-a46d-4775-aacd-9afa7c2075df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce61548-c8b0-4cee-b8d6-6af5568b66af', 'volume_name': 'volume-dce61548-c8b0-4cee-b8d6-6af5568b66af', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80030d32-3ec3-4228-bc35-875baf49dd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80030d32-3ec3-4228-bc35-875baf49dd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3dede3-f0df-4aba-b2f5-c7a96768874e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:05 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Volume dce61548-c8b0-4cee-b8d6-6af5568b66af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce61548-c8b0-4cee-b8d6-6af5568b66af', 'volume_size': 1} Apr 13 17:26:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Flow 'volume_create_manager' (0c8a5533-9f63-498c-9af9-dac677c75962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:06 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ffed4a-5a7a-4be5-a6f2-4d7626ba3696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ffed4a-5a7a-4be5-a6f2-4d7626ba3696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1509335112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd624a1-2e54-46b8-8759-01a0d62e72dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6589efcf707449f893b521e44db798ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:06Z,use_quota=True,user_id='8cc01dea9b454aaf890ce145bcd6d5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfd7d04-373a-40c8-be37-802fabdc1897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfd7d04-373a-40c8-be37-802fabdc1897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daeeba90-7619-466e-80eb-cce02356789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daeeba90-7619-466e-80eb-cce02356789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd624a1-2e54-46b8-8759-01a0d62e72dc', 'volume_name': 'volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83c4cf5-981b-4704-8283-120f00aca7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83c4cf5-981b-4704-8283-120f00aca7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e52d7f-8395-48eb-9cca-322fa8f56418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:06 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Volume 7fd624a1-2e54-46b8-8759-01a0d62e72dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc', 'volume_size': 1} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.info" returned: 0 in 1.473s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:06 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.info is being set with open permissions: ugo+rw Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:06 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.info Apr 13 17:26:06 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Flow 'volume_create_manager' (c54b961d-ebbd-48a2-bef2-db9663dd00bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0876571-7f63-4353-a970-8268faf3f03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0876571-7f63-4353-a970-8268faf3f03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-106980774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6f4662-05a9-49f7-8603-a522d07b9c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6589efcf707449f893b521e44db798ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:07Z,use_quota=True,user_id='8cc01dea9b454aaf890ce145bcd6d5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe64a6a7-98f8-498c-8c61-9edb9c3a5cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe64a6a7-98f8-498c-8c61-9edb9c3a5cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4be0670-5591-4f0b-b1c9-1f8b2b1ffc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4be0670-5591-4f0b-b1c9-1f8b2b1ffc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d6f4662-05a9-49f7-8603-a522d07b9c50', 'volume_name': 'volume-6d6f4662-05a9-49f7-8603-a522d07b9c50', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0b6295-5a86-4144-81ee-4c1728d2fad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0b6295-5a86-4144-81ee-4c1728d2fad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2e87c1-6cd1-4aed-b361-f65b6fa3ea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:06 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Volume 6d6f4662-05a9-49f7-8603-a522d07b9c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d6f4662-05a9-49f7-8603-a522d07b9c50', 'volume_size': 1} Apr 13 17:26:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:07 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.info" returned: 0 in 0.602s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.608s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-280330060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24272bea-1b60-451e-8e29-ab64504503c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6589efcf707449f893b521e44db798ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:05Z,use_quota=True,user_id='8cc01dea9b454aaf890ce145bcd6d5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Creating volume 24272bea-1b60-451e-8e29-ab64504503c6 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:07 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-24272bea-1b60-451e-8e29-ab64504503c6 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:07 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-951d1576-2626-46e3-8076-c86f20cdd1a3 tempest-VolumesDeleteCascade-1058011805 None] Create snapshot completed successfully Apr 13 17:26:07 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-24272bea-1b60-451e-8e29-ab64504503c6 1073741824 Apr 13 17:26:07 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:07 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-24272bea-1b60-451e-8e29-ab64504503c6 1073741824" returned: 0 in 0.793s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-24272bea-1b60-451e-8e29-ab64504503c6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:07 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-24272bea-1b60-451e-8e29-ab64504503c6 Apr 13 17:26:07 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:08 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-24272bea-1b60-451e-8e29-ab64504503c6" returned: 0 in 0.670s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.920s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-100624324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20f11bf-76ae-462c-9da0-c47babd7d5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6589efcf707449f893b521e44db798ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:05Z,use_quota=True,user_id='8cc01dea9b454aaf890ce145bcd6d5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Creating volume b20f11bf-76ae-462c-9da0-c47babd7d5e2 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:08 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:08 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2 1073741824 Apr 13 17:26:08 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c04921-9c7a-45b2-9ed9-d8e8d15876ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24272bea-1b60-451e-8e29-ab64504503c6', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed67309-9b22-41de-a3bb-440efc771ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:08 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Volume volume-24272bea-1b60-451e-8e29-ab64504503c6 (24272bea-1b60-451e-8e29-ab64504503c6): created successfully Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed67309-9b22-41de-a3bb-440efc771ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Flow 'volume_create_manager' (5ce32f22-f635-4134-a014-a983554c7e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:08 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-308cf356-8587-495f-87ef-5c6dacbced65 tempest-CreateVolumesFromImageTest-1898148177 None] Created volume successfully. Apr 13 17:26:09 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2 1073741824" returned: 0 in 0.646s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:09 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2 Apr 13 17:26:09 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:09 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2" returned: 0 in 0.599s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1821273767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce61548-c8b0-4cee-b8d6-6af5568b66af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6589efcf707449f893b521e44db798ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:06Z,use_quota=True,user_id='8cc01dea9b454aaf890ce145bcd6d5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Creating volume dce61548-c8b0-4cee-b8d6-6af5568b66af {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:09 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dce61548-c8b0-4cee-b8d6-6af5568b66af 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f498a70-59e2-4348-a2e3-6def0eb6462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2995c072-afc4-419b-a4c7-1877db812dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:09 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dce61548-c8b0-4cee-b8d6-6af5568b66af 1073741824 Apr 13 17:26:09 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:09 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Volume volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2 (b20f11bf-76ae-462c-9da0-c47babd7d5e2): created successfully Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2995c072-afc4-419b-a4c7-1877db812dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Flow 'volume_create_manager' (95829304-77bd-434e-a87b-1f426ac58205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:09 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-8b345f10-f423-49da-8030-22ccb827e91f tempest-CreateVolumesFromImageTest-1898148177 None] Created volume successfully. Apr 13 17:26:10 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dce61548-c8b0-4cee-b8d6-6af5568b66af 1073741824" returned: 0 in 0.789s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dce61548-c8b0-4cee-b8d6-6af5568b66af {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:10 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dce61548-c8b0-4cee-b8d6-6af5568b66af Apr 13 17:26:10 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:11 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dce61548-c8b0-4cee-b8d6-6af5568b66af" returned: 0 in 0.530s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.782s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1509335112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd624a1-2e54-46b8-8759-01a0d62e72dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6589efcf707449f893b521e44db798ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:06Z,use_quota=True,user_id='8cc01dea9b454aaf890ce145bcd6d5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Creating volume 7fd624a1-2e54-46b8-8759-01a0d62e72dc {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:11 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3dede3-f0df-4aba-b2f5-c7a96768874e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce61548-c8b0-4cee-b8d6-6af5568b66af', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f403ea8f-fc1c-4d59-bb99-d1a97e68f03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:11 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc 1073741824 Apr 13 17:26:11 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:11 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Volume volume-dce61548-c8b0-4cee-b8d6-6af5568b66af (dce61548-c8b0-4cee-b8d6-6af5568b66af): created successfully Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f403ea8f-fc1c-4d59-bb99-d1a97e68f03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Flow 'volume_create_manager' (ee2aaadd-2e94-4560-aa47-bbb2061d3791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:11 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d4fc38f0-64d6-4c24-aeb2-e275112ab375 tempest-CreateVolumesFromImageTest-1898148177 None] Created volume successfully. Apr 13 17:26:11 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc 1073741824" returned: 0 in 0.581s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:11 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc Apr 13 17:26:11 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:12 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc" returned: 0 in 0.573s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.503s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-106980774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6f4662-05a9-49f7-8603-a522d07b9c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6589efcf707449f893b521e44db798ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:07Z,use_quota=True,user_id='8cc01dea9b454aaf890ce145bcd6d5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Creating volume 6d6f4662-05a9-49f7-8603-a522d07b9c50 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:12 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6d6f4662-05a9-49f7-8603-a522d07b9c50 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e52d7f-8395-48eb-9cca-322fa8f56418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88470466-862f-4b63-a2da-9b78d9859771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:12 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6d6f4662-05a9-49f7-8603-a522d07b9c50 1073741824 Apr 13 17:26:12 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:12 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Volume volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc (7fd624a1-2e54-46b8-8759-01a0d62e72dc): created successfully Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88470466-862f-4b63-a2da-9b78d9859771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:12 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Flow 'volume_create_manager' (0c8a5533-9f63-498c-9af9-dac677c75962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:12 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-dda67a10-15b9-4a76-8e70-7d405df2c64a tempest-CreateVolumesFromImageTest-1898148177 None] Created volume successfully. Apr 13 17:26:13 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6d6f4662-05a9-49f7-8603-a522d07b9c50 1073741824" returned: 0 in 0.608s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6d6f4662-05a9-49f7-8603-a522d07b9c50 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:13 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6d6f4662-05a9-49f7-8603-a522d07b9c50 Apr 13 17:26:13 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:13 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6d6f4662-05a9-49f7-8603-a522d07b9c50" returned: 0 in 0.516s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.483s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] Creating offline snapshot d3271b0d-1968-45c1-8a46-57bbf58ab6da of volume 60d13cb4-037a-427a-ba99-e32c23d5c19a {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2e87c1-6cd1-4aed-b361-f65b6fa3ea6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d6f4662-05a9-49f7-8603-a522d07b9c50', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78020cb3-51cb-40c6-9dd2-965f13944fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db7f57e-4b7b-49ed-9286-f3d9c3808e13]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:13 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Volume volume-6d6f4662-05a9-49f7-8603-a522d07b9c50 (6d6f4662-05a9-49f7-8603-a522d07b9c50): created successfully Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78020cb3-51cb-40c6-9dd2-965f13944fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Flow 'volume_create_manager' (c54b961d-ebbd-48a2-bef2-db9663dd00bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:13 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-323336c6-80ba-498d-a67c-c8b2c1492dee tempest-CreateVolumesFromImageTest-1898148177 None] Created volume successfully. Apr 13 17:26:13 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 Apr 13 17:26:13 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:14 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4" returned: 0 in 0.533s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:14 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d13cb4-037a-427a-ba99-e32c23d5c19a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:26:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:14 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da 1G Apr 13 17:26:14 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "cinder-6d6f4662-05a9-49f7-8603-a522d07b9c50-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-6d6f4662-05a9-49f7-8603-a522d07b9c50-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "cinder-quobyte-6d6f4662-05a9-49f7-8603-a522d07b9c50" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-quobyte-6d6f4662-05a9-49f7-8603-a522d07b9c50" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:14 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f07144-4db4-43a8-aaef-d7e0dbe750fa]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6d6f4662-05a9-49f7-8603-a522d07b9c50 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:14 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6d6f4662-05a9-49f7-8603-a522d07b9c50 Apr 13 17:26:14 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:14 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da 1G" returned: 0 in 0.623s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:14 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da Apr 13 17:26:14 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:15 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6d6f4662-05a9-49f7-8603-a522d07b9c50" returned: 0 in 0.528s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6d6f4662-05a9-49f7-8603-a522d07b9c50 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:15 devstack sudo[87202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6d6f4662-05a9-49f7-8603-a522d07b9c50 Apr 13 17:26:15 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:15 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da" returned: 0 in 0.483s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:15 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da is being set with open permissions: ugo+rw Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:15 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da Apr 13 17:26:15 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:15 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6d6f4662-05a9-49f7-8603-a522d07b9c50" returned: 0 in 0.529s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-quobyte-6d6f4662-05a9-49f7-8603-a522d07b9c50" released by "delete_volume" :: held 1.095s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Created reservations ['605a2fc3-a954-4fa8-af26-188f01af449d', 'eda86392-0df9-48d6-a38c-f85e8fd946c7', '9a36a89e-9586-4590-b44c-376e58707cfe', 'dbe8b765-cc6d-4e2f-90d2-f8af7f6b9019'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:15 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:15 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:15 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da" returned: 0 in 0.584s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:15 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-5c0e70a8-9ea5-47ac-97d2-e8532e771f6e tempest-VolumesDeleteCascade-1058011805 None] Create snapshot completed successfully Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-60d13cb4-037a-427a-ba99-e32c23d5c19a-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-60d13cb4-037a-427a-ba99-e32c23d5c19a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Performing cascade delete. {{(pid=81998) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-961a8f94-2884-415d-a234-eaf0ab91b6b4-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:16 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-961a8f94-2884-415d-a234-eaf0ab91b6b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.622s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-quobyte-60d13cb4-037a-427a-ba99-e32c23d5c19a" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:16 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Deleted volume successfully. Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-60d13cb4-037a-427a-ba99-e32c23d5c19a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-quobyte-961a8f94-2884-415d-a234-eaf0ab91b6b4" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-961a8f94-2884-415d-a234-eaf0ab91b6b4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Deleting offline snapshot 961a8f94-2884-415d-a234-eaf0ab91b6b4 of volume 60d13cb4-037a-427a-ba99-e32c23d5c19a {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] snapshot_file for this snap is: volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0e6577ab-cf69-400c-8e82-3b20349d5fbc tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-6d6f4662-05a9-49f7-8603-a522d07b9c50-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2d4c5a-a76d-4101-be6a-b9359aef475c]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:16 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 Apr 13 17:26:16 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "cinder-7fd624a1-2e54-46b8-8759-01a0d62e72dc-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-7fd624a1-2e54-46b8-8759-01a0d62e72dc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "cinder-quobyte-7fd624a1-2e54-46b8-8759-01a0d62e72dc" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-quobyte-7fd624a1-2e54-46b8-8759-01a0d62e72dc" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[73656beb-6ac4-44c3-9ccb-bc423782238a]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:16 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc Apr 13 17:26:16 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:17 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4" returned: 0 in 0.710s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:17 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d13cb4-037a-427a-ba99-e32c23d5c19a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:26:17 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ee9702-19a5-4805-bc12-c54880889d67]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:17 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a Apr 13 17:26:17 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:17 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc" returned: 0 in 0.917s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:17 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc Apr 13 17:26:17 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:17 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a" returned: 0 in 0.675s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:17 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5617b39d-f71d-4d47-8e43-8508c75538f4]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:18 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da Apr 13 17:26:18 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:18 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7fd624a1-2e54-46b8-8759-01a0d62e72dc" returned: 0 in 0.880s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:18 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-quobyte-7fd624a1-2e54-46b8-8759-01a0d62e72dc" released by "delete_volume" :: held 1.863s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:18 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Created reservations ['6147e90a-0d7d-48c5-97b9-d6eaf3d7aace', 'c7897aac-5a29-41e2-b7eb-c4934b5666cd', '66d150e1-14fd-4266-b714-9fb8a8dd9eae', 'c5019d6b-ca5d-4f36-9c40-060724bb5164'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:19 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:19 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "cinder-dce61548-c8b0-4cee-b8d6-6af5568b66af-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-dce61548-c8b0-4cee-b8d6-6af5568b66af-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "cinder-quobyte-dce61548-c8b0-4cee-b8d6-6af5568b66af" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:19 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da" returned: 0 in 1.252s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d13cb4-037a-427a-ba99-e32c23d5c19a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1938fca9-5561-4478-9464-cfd26115338a]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-quobyte-dce61548-c8b0-4cee-b8d6-6af5568b66af" acquired by "delete_volume" :: waited 0.066s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8a0ab9-3650-4020-ad92-cea441171a65]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dce61548-c8b0-4cee-b8d6-6af5568b66af {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:19 devstack sudo[87287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 Apr 13 17:26:19 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:19 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dce61548-c8b0-4cee-b8d6-6af5568b66af Apr 13 17:26:19 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:20 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.998s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:20 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:20 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:20 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Deleted volume successfully. Apr 13 17:26:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4" returned: 0 in 0.812s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d13cb4-037a-427a-ba99-e32c23d5c19a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:26:20 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e62049e4-e6fb-4dba-9bf0-43962d15a7d8 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-7fd624a1-2e54-46b8-8759-01a0d62e72dc-delete_volume" released by "delete_volume" :: held 3.291s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:20 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5064a70-7fe5-43e8-9aa2-7dcb4b1c80f4]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:20 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a Apr 13 17:26:20 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:20 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dce61548-c8b0-4cee-b8d6-6af5568b66af" returned: 0 in 1.167s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dce61548-c8b0-4cee-b8d6-6af5568b66af {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:20 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dce61548-c8b0-4cee-b8d6-6af5568b66af Apr 13 17:26:20 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:21 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a" returned: 0 in 1.106s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:21 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 Apr 13 17:26:21 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:21 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dce61548-c8b0-4cee-b8d6-6af5568b66af" returned: 0 in 0.683s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-quobyte-dce61548-c8b0-4cee-b8d6-6af5568b66af" released by "delete_volume" :: held 1.946s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Created reservations ['bc481d40-d23f-4bd8-bd8e-4354de6006de', '4e8d208d-bd65-43d1-b4c4-5c1e09ab08f8', '584d41d9-2624-46d3-a1fb-4ab75247ac4a', 'c926dbc4-7bb7-4f7d-8c09-691b56f35bb7'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:21 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:21 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "cinder-b20f11bf-76ae-462c-9da0-c47babd7d5e2-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-b20f11bf-76ae-462c-9da0-c47babd7d5e2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "cinder-quobyte-b20f11bf-76ae-462c-9da0-c47babd7d5e2" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-quobyte-b20f11bf-76ae-462c-9da0-c47babd7d5e2" acquired by "delete_volume" :: waited 0.034s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b910174-f790-4367-9742-420963805ce4]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:21 devstack sudo[87317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2 Apr 13 17:26:21 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:22 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4" returned: 0 in 1.284s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:22 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4 Apr 13 17:26:22 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:22 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2" returned: 0 in 1.077s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:22 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2 Apr 13 17:26:22 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:22 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 1.401s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:22 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:22 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Deleted volume successfully. Apr 13 17:26:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01146d7e-18bf-47dd-91e0-c579a56153a5 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-dce61548-c8b0-4cee-b8d6-6af5568b66af-delete_volume" released by "delete_volume" :: held 3.702s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:23 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.961a8f94-2884-415d-a234-eaf0ab91b6b4" returned: 0 in 0.806s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d13cb4-037a-427a-ba99-e32c23d5c19a /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da -F qcow2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:23 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d13cb4-037a-427a-ba99-e32c23d5c19a /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da -F qcow2 Apr 13 17:26:23 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:23 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b20f11bf-76ae-462c-9da0-c47babd7d5e2" returned: 0 in 0.846s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-quobyte-b20f11bf-76ae-462c-9da0-c47babd7d5e2" released by "delete_volume" :: held 1.983s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Created reservations ['254ca4b3-699b-489b-ba56-f9797882917a', 'd207df6a-aca1-4dd0-a969-3c3401a8d189', 'd720b75c-5ff7-4ec9-9339-031b599e57ff', 'e10f11cd-3a15-43d9-a463-5c569d447f2c'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:23 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:23 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "cinder-24272bea-1b60-451e-8e29-ab64504503c6-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-24272bea-1b60-451e-8e29-ab64504503c6-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "cinder-quobyte-24272bea-1b60-451e-8e29-ab64504503c6" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-quobyte-24272bea-1b60-451e-8e29-ab64504503c6" acquired by "delete_volume" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2fc882-bc05-4d8b-b235-7c3edac99973]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-24272bea-1b60-451e-8e29-ab64504503c6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:24 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:24 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-24272bea-1b60-451e-8e29-ab64504503c6 Apr 13 17:26:24 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d13cb4-037a-427a-ba99-e32c23d5c19a /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da -F qcow2" returned: 0 in 0.970s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-961a8f94-2884-415d-a234-eaf0ab91b6b4" released by "_delete_snapshot" :: held 7.744s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-60d13cb4-037a-427a-ba99-e32c23d5c19a" released by "delete_snapshot" :: held 7.767s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Created reservations ['bf2eaba3-d82d-4f2c-9078-9a01bd546c12', '03fcf860-58f7-4622-b2a0-06472bfc9fe3', '98d1def0-9f20-4f41-bbdd-ea43cc26ff33', '196ecd91-7d19-4b6e-898a-ad7c2f8dcbdf'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:24 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Delete snapshot completed successfully. Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-961a8f94-2884-415d-a234-eaf0ab91b6b4-delete_snapshot" released by "delete_snapshot" :: held 8.182s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-d3271b0d-1968-45c1-8a46-57bbf58ab6da-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-d3271b0d-1968-45c1-8a46-57bbf58ab6da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-quobyte-60d13cb4-037a-427a-ba99-e32c23d5c19a" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-60d13cb4-037a-427a-ba99-e32c23d5c19a" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-quobyte-d3271b0d-1968-45c1-8a46-57bbf58ab6da" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-d3271b0d-1968-45c1-8a46-57bbf58ab6da" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Deleting offline snapshot d3271b0d-1968-45c1-8a46-57bbf58ab6da of volume 60d13cb4-037a-427a-ba99-e32c23d5c19a {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] snapshot_file for this snap is: volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4560ee50-7cfa-47ea-a194-705de7902df7]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:25 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da Apr 13 17:26:25 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:25 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-24272bea-1b60-451e-8e29-ab64504503c6" returned: 0 in 1.125s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-24272bea-1b60-451e-8e29-ab64504503c6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:25 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-24272bea-1b60-451e-8e29-ab64504503c6 Apr 13 17:26:25 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:25 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 1.494s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:25 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:25 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Deleted volume successfully. Apr 13 17:26:25 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ada3e7f2-04df-44bd-827c-73e845ae7a65 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-b20f11bf-76ae-462c-9da0-c47babd7d5e2-delete_volume" released by "delete_volume" :: held 3.777s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:25 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-24272bea-1b60-451e-8e29-ab64504503c6" returned: 0 in 0.783s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:25 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-quobyte-24272bea-1b60-451e-8e29-ab64504503c6" released by "delete_volume" :: held 1.939s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:25 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Created reservations ['72d52a7d-be04-43ec-8adb-a9e03e135ff9', 'e40dad93-4846-4e31-b09a-7fc46339bd75', '0a144c1b-e52f-4523-8785-d39fae754ddb', 'c715c7a1-7aac-4bc7-9733-8d74d8e67c29'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:25 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da" returned: 0 in 1.165s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d13cb4-037a-427a-ba99-e32c23d5c19a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[002a2a3b-050e-4baa-b117-24773eed43d6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:26 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:26 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:26 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a Apr 13 17:26:26 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Flow 'volume_create_manager' (86b37995-74d0-4e98-affd-09e6b9c8c5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5febdd-eb26-4c08-b868-c221790aee49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5febdd-eb26-4c08-b868-c221790aee49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2146012142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b910904-da7d-4cb0-89ff-caf9e6a0fdab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef48253aab9407c8133c4158e85d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:27Z,use_quota=True,user_id='9214eb1dfd8c4b85bfa34a039043c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d9a19a-9a55-4db6-a472-7dd56281333d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d9a19a-9a55-4db6-a472-7dd56281333d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b131885-130a-413f-8c52-432f0d0a75a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b131885-130a-413f-8c52-432f0d0a75a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b910904-da7d-4cb0-89ff-caf9e6a0fdab', 'volume_name': 'volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d428061-2eb8-4a8a-94d3-607022057a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d428061-2eb8-4a8a-94d3-607022057a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3158af-967f-46ef-80cb-168009ab0325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:26 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Volume 3b910904-da7d-4cb0-89ff-caf9e6a0fdab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab', 'volume_size': 1} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2146012142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b910904-da7d-4cb0-89ff-caf9e6a0fdab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef48253aab9407c8133c4158e85d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:27Z,use_quota=True,user_id='9214eb1dfd8c4b85bfa34a039043c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Creating volume 3b910904-da7d-4cb0-89ff-caf9e6a0fdab {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:26 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:27 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 1.038s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:27 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab 1073741824 Apr 13 17:26:27 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:27 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:27 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Deleted volume successfully. Apr 13 17:26:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-4c200edf-d2af-4cb3-8700-6615e0c388d7 tempest-CreateVolumesFromImageTest-1898148177 None] Lock "cinder-24272bea-1b60-451e-8e29-ab64504503c6-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:27 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a" returned: 0 in 1.484s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:27 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da Apr 13 17:26:27 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:28 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab 1073741824" returned: 0 in 1.100s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:28 devstack sudo[87445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab Apr 13 17:26:28 devstack sudo[87445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:28 devstack sudo[87445]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab" returned: 0 in 0.511s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3158af-967f-46ef-80cb-168009ab0325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03778e76-384c-4ad5-ace5-b27e82fb92a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:28 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da" returned: 0 in 1.185s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:28 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Volume volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab (3b910904-da7d-4cb0-89ff-caf9e6a0fdab): created successfully Apr 13 17:26:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03778e76-384c-4ad5-ace5-b27e82fb92a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Flow 'volume_create_manager' (86b37995-74d0-4e98-affd-09e6b9c8c5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:28 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da Apr 13 17:26:28 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:28 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-35dd159e-68cb-4291-81bd-f71e7a6fbc26 tempest-VolumesActionsTest-1123284758 None] Created volume successfully. Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-7ac27770-ec52-4479-b4ad-136b1b67cfde tempest-VolumesActionsTest-1123284758 None] Acquiring lock "cinder-3b910904-da7d-4cb0-89ff-caf9e6a0fdab" by "attach_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-7ac27770-ec52-4479-b4ad-136b1b67cfde tempest-VolumesActionsTest-1123284758 None] Lock "cinder-3b910904-da7d-4cb0-89ff-caf9e6a0fdab" acquired by "attach_volume" :: waited 0.031s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:29 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-7ac27770-ec52-4479-b4ad-136b1b67cfde tempest-VolumesActionsTest-1123284758 None] Attaching volume 3b910904-da7d-4cb0-89ff-caf9e6a0fdab to instance 755fc724-1676-4fa9-8a2a-486a183d53d0 at mountpoint /dev/vdb on host None. Apr 13 17:26:29 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-7ac27770-ec52-4479-b4ad-136b1b67cfde tempest-VolumesActionsTest-1123284758 None] Attach volume completed successfully. Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-7ac27770-ec52-4479-b4ad-136b1b67cfde tempest-VolumesActionsTest-1123284758 None] Lock "cinder-3b910904-da7d-4cb0-89ff-caf9e6a0fdab" released by "attach_volume" :: held 0.078s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Flow 'volume_create_manager' (b0ecb7e4-206f-4d69-9b85-a055da02d60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28a066b-7a5a-4581-937e-0a4057730c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28a066b-7a5a-4581-937e-0a4057730c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1101053464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d895f87-1766-4dac-a41c-a0b79fc3a2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb21a7fac7a948879be230688efd2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:29Z,use_quota=True,user_id='830338098ad34d948bbcfa5875ddb56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40dc54d4-088a-48b6-96fd-76efc2eaa1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40dc54d4-088a-48b6-96fd-76efc2eaa1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351167d3-206a-4176-9aad-638651b57693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351167d3-206a-4176-9aad-638651b57693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d895f87-1766-4dac-a41c-a0b79fc3a2ef', 'volume_name': 'volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d9fca2-b126-4fa1-99c7-3e210a376d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d9fca2-b126-4fa1-99c7-3e210a376d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1a035c-5d1a-471e-9be6-4cb9beba3810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:29 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume 4d895f87-1766-4dac-a41c-a0b79fc3a2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef', 'volume_size': 1} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1101053464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d895f87-1766-4dac-a41c-a0b79fc3a2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb21a7fac7a948879be230688efd2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:29Z,use_quota=True,user_id='830338098ad34d948bbcfa5875ddb56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Creating volume 4d895f87-1766-4dac-a41c-a0b79fc3a2ef {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:29 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:29 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef 1073741824 Apr 13 17:26:29 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:29 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a.d3271b0d-1968-45c1-8a46-57bbf58ab6da" returned: 0 in 0.816s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-d3271b0d-1968-45c1-8a46-57bbf58ab6da" released by "_delete_snapshot" :: held 4.791s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-60d13cb4-037a-427a-ba99-e32c23d5c19a" released by "delete_snapshot" :: held 4.810s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Created reservations ['93209300-cd93-4c79-9130-a31069a6c923', 'd5f12e19-97fe-4ac0-8349-9b9cd7fe8454', '9fae74b7-f70f-499e-abf7-28aec970de98', 'd96378f0-4147-4147-8bd5-93c75a58cabb'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:29 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Delete snapshot completed successfully. Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-d3271b0d-1968-45c1-8a46-57bbf58ab6da-delete_snapshot" released by "delete_snapshot" :: held 4.975s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Snapshots deleted, issuing volume delete {{(pid=81998) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-quobyte-60d13cb4-037a-427a-ba99-e32c23d5c19a" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-60d13cb4-037a-427a-ba99-e32c23d5c19a" acquired by "delete_volume" :: waited 0.007s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a1aacb-8ac4-4c5f-93d7-cd7e7a0a3d87]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:29 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a Apr 13 17:26:29 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:30 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef 1073741824" returned: 0 in 0.692s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:30 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef Apr 13 17:26:30 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:30 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-7b6e418c-5e3d-4335-9999-5d89cbed6584 tempest-VolumesActionsTest-688251563 None] Terminate volume connection completed successfully. Apr 13 17:26:30 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a" returned: 0 in 0.707s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:30 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a Apr 13 17:26:30 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:30 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef" returned: 0 in 0.542s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1a035c-5d1a-471e-9be6-4cb9beba3810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05b960c-d7e2-4bb6-a564-eba484b8cb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-7b6e418c-5e3d-4335-9999-5d89cbed6584 tempest-VolumesActionsTest-688251563 None] Acquiring lock "cinder-3b910904-da7d-4cb0-89ff-caf9e6a0fdab-detach_volume" by "detach_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:30 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef (4d895f87-1766-4dac-a41c-a0b79fc3a2ef): created successfully Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05b960c-d7e2-4bb6-a564-eba484b8cb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Flow 'volume_create_manager' (b0ecb7e4-206f-4d69-9b85-a055da02d60a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:30 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-28ef3fa0-c3b9-4188-a9fa-97dfc8394728 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created volume successfully. Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-7b6e418c-5e3d-4335-9999-5d89cbed6584 tempest-VolumesActionsTest-688251563 None] Lock "cinder-3b910904-da7d-4cb0-89ff-caf9e6a0fdab-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:30 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-7b6e418c-5e3d-4335-9999-5d89cbed6584 tempest-VolumesActionsTest-688251563 None] Detaching volume 3b910904-da7d-4cb0-89ff-caf9e6a0fdab from instance 755fc724-1676-4fa9-8a2a-486a183d53d0. Apr 13 17:26:30 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-7b6e418c-5e3d-4335-9999-5d89cbed6584 tempest-VolumesActionsTest-688251563 None] Detach volume completed successfully. Apr 13 17:26:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-7b6e418c-5e3d-4335-9999-5d89cbed6584 tempest-VolumesActionsTest-688251563 None] Lock "cinder-3b910904-da7d-4cb0-89ff-caf9e6a0fdab-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:31 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-60d13cb4-037a-427a-ba99-e32c23d5c19a" returned: 0 in 0.632s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-60d13cb4-037a-427a-ba99-e32c23d5c19a" released by "delete_volume" :: held 1.420s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Created reservations ['9b8c22ea-5688-4089-be52-4fb607026c87', '02f8091c-c004-4584-88f5-5b6d79db3f60', '2b3092ab-2741-40e8-a218-4e49e96ccc3c', '436bbc5a-7bf2-44e9-a417-fa28ef8d656d'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Flow 'volume_create_manager' (a2075e2f-c402-4367-b185-2b6a31289c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d870674f-e88b-4c13-b3a6-52fdc7d5aa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d870674f-e88b-4c13-b3a6-52fdc7d5aa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1434297662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15aea280-e004-4f92-9510-3c6962cb55b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe3b9feae634d00837ed18ade48045a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:31Z,use_quota=True,user_id='d7e6f1605e1d42c68572b3921230cce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161e5122-8c50-4228-b705-e70dbfcfbc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161e5122-8c50-4228-b705-e70dbfcfbc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3114a23f-0b56-47e4-aa75-25ce1ebc7c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3114a23f-0b56-47e4-aa75-25ce1ebc7c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15aea280-e004-4f92-9510-3c6962cb55b2', 'volume_name': 'volume-15aea280-e004-4f92-9510-3c6962cb55b2', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538feb57-bb8a-45e2-b738-5a28002e17db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538feb57-bb8a-45e2-b738-5a28002e17db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871db723-6502-4505-af9e-e2ad3ad2789e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:31 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Volume 15aea280-e004-4f92-9510-3c6962cb55b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15aea280-e004-4f92-9510-3c6962cb55b2', 'volume_size': 1} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1434297662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15aea280-e004-4f92-9510-3c6962cb55b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe3b9feae634d00837ed18ade48045a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:31Z,use_quota=True,user_id='d7e6f1605e1d42c68572b3921230cce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Creating volume 15aea280-e004-4f92-9510-3c6962cb55b2 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:31 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-15aea280-e004-4f92-9510-3c6962cb55b2 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:31 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-15aea280-e004-4f92-9510-3c6962cb55b2 1073741824 Apr 13 17:26:31 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:31 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:31 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-73ea9c18-59cb-4c34-ad69-86aa16774f30 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "cinder-3b910904-da7d-4cb0-89ff-caf9e6a0fdab-detach_volume" by "detach_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-73ea9c18-59cb-4c34-ad69-86aa16774f30 tempest-VolumesActionsTest-1123284758 None] Lock "cinder-3b910904-da7d-4cb0-89ff-caf9e6a0fdab-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:31 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-73ea9c18-59cb-4c34-ad69-86aa16774f30 tempest-VolumesActionsTest-1123284758 None] Volume detach called, but volume not attached. Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-73ea9c18-59cb-4c34-ad69-86aa16774f30 tempest-VolumesActionsTest-1123284758 None] Lock "cinder-3b910904-da7d-4cb0-89ff-caf9e6a0fdab-detach_volume" released by "detach_volume" :: held 0.045s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:32 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.877s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:32 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Deleted volume successfully. Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec50980d-57f2-4cc1-88a8-885f2fc3e813 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-60d13cb4-037a-427a-ba99-e32c23d5c19a-delete_volume" released by "delete_volume" :: held 15.895s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Acquiring lock "cinder-3b910904-da7d-4cb0-89ff-caf9e6a0fdab-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Lock "cinder-3b910904-da7d-4cb0-89ff-caf9e6a0fdab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Acquiring lock "cinder-quobyte-3b910904-da7d-4cb0-89ff-caf9e6a0fdab" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Lock "cinder-quobyte-3b910904-da7d-4cb0-89ff-caf9e6a0fdab" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[942fb84f-393f-4ef2-9658-d920c52fed85]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:32 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-15aea280-e004-4f92-9510-3c6962cb55b2 1073741824" returned: 0 in 1.189s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-15aea280-e004-4f92-9510-3c6962cb55b2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:32 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab Apr 13 17:26:32 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:32 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-15aea280-e004-4f92-9510-3c6962cb55b2 Apr 13 17:26:32 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Flow 'volume_create_manager' (513be474-da30-4d27-bc7a-205bcb7fd828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc2322d-6d9a-429b-b070-d3c77901414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc2322d-6d9a-429b-b070-d3c77901414a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-211954745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b982fc14-2c85-4c8f-b8d3-7730a7a28b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5a0c2f1cc14f2394b880f5c595b760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:33Z,use_quota=True,user_id='86855a2632bd4b37b7fd9b0e0fab84d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e44b68-1fd8-45e1-a26f-1bb254f92b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e44b68-1fd8-45e1-a26f-1bb254f92b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4883db-5cd2-4e0a-b5eb-f36d37aa33a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4883db-5cd2-4e0a-b5eb-f36d37aa33a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b982fc14-2c85-4c8f-b8d3-7730a7a28b1e', 'volume_name': 'volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3522e481-4aae-439a-9f15-56ee80ccac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3522e481-4aae-439a-9f15-56ee80ccac24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38665820-f2fa-4951-a612-173b9f0cadf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:33 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Volume b982fc14-2c85-4c8f-b8d3-7730a7a28b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e', 'volume_size': 1} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:33 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-15aea280-e004-4f92-9510-3c6962cb55b2" returned: 0 in 0.651s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.499s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871db723-6502-4505-af9e-e2ad3ad2789e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15aea280-e004-4f92-9510-3c6962cb55b2', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e264172-4320-43f4-bf06-d88b619bbf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] Creating offline snapshot 439b8a33-f62d-452e-8a36-023f43aa7afe of volume 4d895f87-1766-4dac-a41c-a0b79fc3a2ef {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:26:33 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Volume volume-15aea280-e004-4f92-9510-3c6962cb55b2 (15aea280-e004-4f92-9510-3c6962cb55b2): created successfully Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e264172-4320-43f4-bf06-d88b619bbf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Flow 'volume_create_manager' (a2075e2f-c402-4367-b185-2b6a31289c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a9c8f-84c3-4225-9f8e-d4ac2934e1dc]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:33 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:33 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-62a21935-54c2-4ead-ab8e-c106d6f59fd6 tempest-ServersNegativeTestJSON-764240758 None] Created volume successfully. Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab" returned: 0 in 0.802s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:33 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab Apr 13 17:26:33 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:33 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef Apr 13 17:26:33 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_service.periodic_task [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:33 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:33 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:33 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef" returned: 0 in 0.663s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:33 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe 1G Apr 13 17:26:33 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:33 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b910904-da7d-4cb0-89ff-caf9e6a0fdab" returned: 0 in 0.707s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:33 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Lock "cinder-quobyte-3b910904-da7d-4cb0-89ff-caf9e6a0fdab" released by "delete_volume" :: held 1.537s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:34 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Created reservations ['150cec39-3ea2-4b62-b3ea-f1391174656c', 'c4ea0d74-0a15-4998-a39e-7f742841278d', '1ae212e5-2604-4e5f-9419-9259afb6ba2d', '5cdf89d7-d49b-4c5b-a030-08c27fd21cb8'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:34 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:34 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:34 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.923s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:35 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe 1G" returned: 0 in 1.288s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:35 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe Apr 13 17:26:35 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:35 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 1.204s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Flow 'volume_create_manager' (0346cec8-e319-4746-b03c-9327735ac0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c206ca-54d3-4472-9cc2-e879b52b20da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:35 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Deleted volume successfully. Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c206ca-54d3-4472-9cc2-e879b52b20da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-567148608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e146f179-3a06-4725-9633-ddfe8a46ab20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe3b9feae634d00837ed18ade48045a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:35Z,use_quota=True,user_id='d7e6f1605e1d42c68572b3921230cce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a255df47-b24b-46d1-93c7-00d79a3c0ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a255df47-b24b-46d1-93c7-00d79a3c0ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcdce4c-bbd1-4bbc-850a-bc7bb57e78eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcdce4c-bbd1-4bbc-850a-bc7bb57e78eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e146f179-3a06-4725-9633-ddfe8a46ab20', 'volume_name': 'volume-e146f179-3a06-4725-9633-ddfe8a46ab20', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e53198-56df-4119-ab13-b9a65d70fab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e53198-56df-4119-ab13-b9a65d70fab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524e8dfa-418c-4ee7-8980-bf9ccd727274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:35 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Volume e146f179-3a06-4725-9633-ddfe8a46ab20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e146f179-3a06-4725-9633-ddfe8a46ab20', 'volume_size': 1} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-44d797d8-4a48-435b-9da6-d5656f1d0e7a tempest-VolumesActionsTest-1123284758 None] Lock "cinder-3b910904-da7d-4cb0-89ff-caf9e6a0fdab-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:35 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe" returned: 0 in 0.639s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:35 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe is being set with open permissions: ugo+rw Apr 13 17:26:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:35 devstack sudo[87573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe Apr 13 17:26:35 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:36 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe" returned: 0 in 0.597s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:36 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.info Apr 13 17:26:36 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:36 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.info" returned: 0 in 0.471s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:36 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.info is being set with open permissions: ugo+rw Apr 13 17:26:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:36 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.info Apr 13 17:26:36 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:37 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.info" returned: 0 in 0.538s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.284s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.367s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-211954745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b982fc14-2c85-4c8f-b8d3-7730a7a28b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5a0c2f1cc14f2394b880f5c595b760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:33Z,use_quota=True,user_id='86855a2632bd4b37b7fd9b0e0fab84d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Creating volume b982fc14-2c85-4c8f-b8d3-7730a7a28b1e {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:37 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:37 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e 1073741824 Apr 13 17:26:37 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-786e672a-fbc2-442e-a11b-115991705fce tempest-CreateVolumesFromSnapshotTest-1375195545 None] Create snapshot completed successfully Apr 13 17:26:37 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:38 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e 1073741824" returned: 0 in 0.570s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:38 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e Apr 13 17:26:38 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Flow 'volume_create_manager' (0f230a5e-7d4d-4e23-804a-475aa48ed2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e2ec1b-e66b-48d4-8011-7a1f52210220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e2ec1b-e66b-48d4-8011-7a1f52210220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-929728126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fa7741-e66a-421c-b2e9-fe45d75c1a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb21a7fac7a948879be230688efd2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:38Z,use_quota=True,user_id='830338098ad34d948bbcfa5875ddb56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934a1ba7-4fe2-4342-b706-82c492d054bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934a1ba7-4fe2-4342-b706-82c492d054bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b88389e-1c0a-4991-b39c-ba4d5af3e684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b88389e-1c0a-4991-b39c-ba4d5af3e684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45fa7741-e66a-421c-b2e9-fe45d75c1a8a', 'volume_name': 'volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3d5ef1-6643-4ef3-b5ce-6c1610ee3c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3d5ef1-6643-4ef3-b5ce-6c1610ee3c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70d790d-5093-4f97-abd5-a0074c745813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume 45fa7741-e66a-421c-b2e9-fe45d75c1a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a', 'volume_size': 1} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Flow 'volume_create_manager' (45d278b2-aac3-4390-940e-7f94142ce9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d7e9ac-7dee-4d9c-b70a-0d77e613dd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d7e9ac-7dee-4d9c-b70a-0d77e613dd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-956327889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43c654c-1d31-4d92-b7b4-2234464eed87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb21a7fac7a948879be230688efd2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:38Z,use_quota=True,user_id='830338098ad34d948bbcfa5875ddb56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5818df0a-4a35-46e3-a808-3aec0b97b4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5818df0a-4a35-46e3-a808-3aec0b97b4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bca9491-aced-4864-a3b5-bc2183afd604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bca9491-aced-4864-a3b5-bc2183afd604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43c654c-1d31-4d92-b7b4-2234464eed87', 'volume_name': 'volume-e43c654c-1d31-4d92-b7b4-2234464eed87', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0671640a-2cb4-43bb-8231-a7fb066c1d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0671640a-2cb4-43bb-8231-a7fb066c1d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7fc6e4-bd5c-4297-ae72-c74da0be5840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume e43c654c-1d31-4d92-b7b4-2234464eed87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43c654c-1d31-4d92-b7b4-2234464eed87', 'volume_size': 1} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:38 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" returned: 0 in 0.651s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.254s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-567148608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e146f179-3a06-4725-9633-ddfe8a46ab20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe3b9feae634d00837ed18ade48045a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:35Z,use_quota=True,user_id='d7e6f1605e1d42c68572b3921230cce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Creating volume e146f179-3a06-4725-9633-ddfe8a46ab20 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:38 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e146f179-3a06-4725-9633-ddfe8a46ab20 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38665820-f2fa-4951-a612-173b9f0cadf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3153407-864b-463a-a42b-ea786d27689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e146f179-3a06-4725-9633-ddfe8a46ab20 1073741824 Apr 13 17:26:38 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:38 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Volume volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e (b982fc14-2c85-4c8f-b8d3-7730a7a28b1e): created successfully Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3153407-864b-463a-a42b-ea786d27689f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Flow 'volume_create_manager' (513be474-da30-4d27-bc7a-205bcb7fd828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:38 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f10bbfd1-7839-44a8-8fe9-cdf514480a21 tempest-VolumesDeleteCascade-1058011805 None] Created volume successfully. Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Flow 'volume_create_manager' (d01d2746-bdeb-4426-be58-20d57dd4480a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9a9f1d-aeeb-4d1e-889b-9564f892708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9a9f1d-aeeb-4d1e-889b-9564f892708a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1347401015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2759b58-72be-4115-bcf6-6066f44e9267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb21a7fac7a948879be230688efd2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:39Z,use_quota=True,user_id='830338098ad34d948bbcfa5875ddb56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73a3181-12dc-4394-9e48-baa0382ae520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73a3181-12dc-4394-9e48-baa0382ae520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca52f75-ef64-4ba3-928c-d47c8cabd2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca52f75-ef64-4ba3-928c-d47c8cabd2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2759b58-72be-4115-bcf6-6066f44e9267', 'volume_name': 'volume-b2759b58-72be-4115-bcf6-6066f44e9267', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee15b56-3e95-49b8-9199-dac78de2cf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee15b56-3e95-49b8-9199-dac78de2cf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a95b552-443e-409e-9c36-f7dc351c9382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:38 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume b2759b58-72be-4115-bcf6-6066f44e9267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2759b58-72be-4115-bcf6-6066f44e9267', 'volume_size': 1} Apr 13 17:26:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Flow 'volume_create_manager' (50fdd24d-a580-4095-81d9-35d289ca8c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cc5b9a-33f9-44ee-ad09-5504b1f44e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cc5b9a-33f9-44ee-ad09-5504b1f44e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2045397458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb21a7fac7a948879be230688efd2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:39Z,use_quota=True,user_id='830338098ad34d948bbcfa5875ddb56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4ebbf1-17c0-4776-ac39-0ccb04af91f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4ebbf1-17c0-4776-ac39-0ccb04af91f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54371481-f94b-4310-b9a0-113b7b57a715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54371481-f94b-4310-b9a0-113b7b57a715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e', 'volume_name': 'volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4660d22d-fbde-4a3b-8dad-e2f5aa9f34cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4660d22d-fbde-4a3b-8dad-e2f5aa9f34cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c8df1b-2a88-4e37-a869-08c85191af84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:39 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume 8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e', 'volume_size': 1} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Flow 'volume_create_manager' (b9a4bd72-a9c9-496d-bb71-f923160a4b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f779d63c-6ed2-445b-8f2b-c318940cfebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f779d63c-6ed2-445b-8f2b-c318940cfebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1678733601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b5832b-801a-4a21-946c-657d12c22337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb21a7fac7a948879be230688efd2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:39Z,use_quota=True,user_id='830338098ad34d948bbcfa5875ddb56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b5f779-ee01-49ab-9788-cd48e61abc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b5f779-ee01-49ab-9788-cd48e61abc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cda62d-b9ef-4a40-bb5a-481a5c487e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cda62d-b9ef-4a40-bb5a-481a5c487e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b5832b-801a-4a21-946c-657d12c22337', 'volume_name': 'volume-e8b5832b-801a-4a21-946c-657d12c22337', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7f6de0-16a7-4776-8552-9806b8ee5de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7f6de0-16a7-4776-8552-9806b8ee5de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ed8d61-c068-4af8-a90b-076659c23edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:39 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume e8b5832b-801a-4a21-946c-657d12c22337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b5832b-801a-4a21-946c-657d12c22337', 'volume_size': 1} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:39 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e146f179-3a06-4725-9633-ddfe8a46ab20 1073741824" returned: 0 in 0.775s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e146f179-3a06-4725-9633-ddfe8a46ab20 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:39 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e146f179-3a06-4725-9633-ddfe8a46ab20 Apr 13 17:26:39 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:39 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e146f179-3a06-4725-9633-ddfe8a46ab20" returned: 0 in 0.465s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.769s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-929728126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fa7741-e66a-421c-b2e9-fe45d75c1a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb21a7fac7a948879be230688efd2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:38Z,use_quota=True,user_id='830338098ad34d948bbcfa5875ddb56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Creating volume 45fa7741-e66a-421c-b2e9-fe45d75c1a8a {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:39 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524e8dfa-418c-4ee7-8980-bf9ccd727274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e146f179-3a06-4725-9633-ddfe8a46ab20', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:39 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a 1073741824 Apr 13 17:26:39 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96f6100-80cd-448e-bbf4-588a51a97f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:39 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:40 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Volume volume-e146f179-3a06-4725-9633-ddfe8a46ab20 (e146f179-3a06-4725-9633-ddfe8a46ab20): created successfully Apr 13 17:26:40 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96f6100-80cd-448e-bbf4-588a51a97f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:40 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Flow 'volume_create_manager' (0346cec8-e319-4746-b03c-9327735ac0e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:40 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b069e8e2-d9fd-4ff8-bd11-caf4ab483b19 tempest-ServersNegativeTestJSON-764240758 None] Created volume successfully. Apr 13 17:26:40 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a 1073741824" returned: 0 in 0.578s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:40 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a Apr 13 17:26:40 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:40 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Acquiring lock "cinder-e146f179-3a06-4725-9633-ddfe8a46ab20-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:40 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Lock "cinder-e146f179-3a06-4725-9633-ddfe8a46ab20-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Acquiring lock "cinder-quobyte-e146f179-3a06-4725-9633-ddfe8a46ab20" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Lock "cinder-quobyte-e146f179-3a06-4725-9633-ddfe8a46ab20" acquired by "delete_volume" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b83b327-57c7-4083-ad85-aaac686ba2a0]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e146f179-3a06-4725-9633-ddfe8a46ab20 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:41 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a" returned: 0 in 0.574s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.685s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-956327889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43c654c-1d31-4d92-b7b4-2234464eed87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb21a7fac7a948879be230688efd2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:38Z,use_quota=True,user_id='830338098ad34d948bbcfa5875ddb56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Creating volume e43c654c-1d31-4d92-b7b4-2234464eed87 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:41 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e43c654c-1d31-4d92-b7b4-2234464eed87 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:41 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e43c654c-1d31-4d92-b7b4-2234464eed87 1073741824 Apr 13 17:26:41 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70d790d-5093-4f97-abd5-a0074c745813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2ba19d-f882-43a5-9c89-280c429e9283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:41 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a (45fa7741-e66a-421c-b2e9-fe45d75c1a8a): created successfully Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2ba19d-f882-43a5-9c89-280c429e9283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:41 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e146f179-3a06-4725-9633-ddfe8a46ab20 Apr 13 17:26:41 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Flow 'volume_create_manager' (0f230a5e-7d4d-4e23-804a-475aa48ed2ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Flow 'volume_create_manager' (86afe1b4-9ba4-45a7-8cca-f81c774f00d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e5206b-f839-4102-b5e6-b5718330b573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:41 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-97d1a3ce-1ade-46a4-a958-902353830841 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created volume successfully. Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e5206b-f839-4102-b5e6-b5718330b573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1846400685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d410274-6c2b-4b36-bca4-5305a8e52728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef48253aab9407c8133c4158e85d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:41Z,use_quota=True,user_id='9214eb1dfd8c4b85bfa34a039043c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f238e96d-1d5f-47cf-8c5d-1507e78500f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f238e96d-1d5f-47cf-8c5d-1507e78500f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d17a4f5-fd7b-4d47-87be-49e1b92d935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d17a4f5-fd7b-4d47-87be-49e1b92d935d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d410274-6c2b-4b36-bca4-5305a8e52728', 'volume_name': 'volume-9d410274-6c2b-4b36-bca4-5305a8e52728', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaeb327d-4a27-4560-8485-fffb0020d979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaeb327d-4a27-4560-8485-fffb0020d979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5067aba3-0fe4-46bf-8de6-cfa7e7e2aa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:41 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Volume 9d410274-6c2b-4b36-bca4-5305a8e52728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d410274-6c2b-4b36-bca4-5305a8e52728', 'volume_size': 1} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:41 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e146f179-3a06-4725-9633-ddfe8a46ab20" returned: 0 in 0.635s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e146f179-3a06-4725-9633-ddfe8a46ab20 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:41 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e43c654c-1d31-4d92-b7b4-2234464eed87 1073741824" returned: 0 in 0.595s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:41 devstack sudo[87636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e146f179-3a06-4725-9633-ddfe8a46ab20 Apr 13 17:26:41 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e43c654c-1d31-4d92-b7b4-2234464eed87 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:41 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e43c654c-1d31-4d92-b7b4-2234464eed87 Apr 13 17:26:41 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:42 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e146f179-3a06-4725-9633-ddfe8a46ab20" returned: 0 in 0.439s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Lock "cinder-quobyte-e146f179-3a06-4725-9633-ddfe8a46ab20" released by "delete_volume" :: held 1.138s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:42 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e43c654c-1d31-4d92-b7b4-2234464eed87" returned: 0 in 0.460s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.403s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1347401015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2759b58-72be-4115-bcf6-6066f44e9267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb21a7fac7a948879be230688efd2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:39Z,use_quota=True,user_id='830338098ad34d948bbcfa5875ddb56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Creating volume b2759b58-72be-4115-bcf6-6066f44e9267 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:42 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b2759b58-72be-4115-bcf6-6066f44e9267 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Created reservations ['cd2bd699-ef58-4a08-a80c-859b2d58d214', 'ed929137-4cb1-4a58-8039-18706f4049f2', '332ec273-941e-4aa2-981f-711873aafc46', 'd56018af-267c-4e76-9f32-2a12c4f44678'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:42 devstack sudo[87642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b2759b58-72be-4115-bcf6-6066f44e9267 1073741824 Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7fc6e4-bd5c-4297-ae72-c74da0be5840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43c654c-1d31-4d92-b7b4-2234464eed87', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:42 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c84a94-3a99-479b-a60d-3895f679a5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:42 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume volume-e43c654c-1d31-4d92-b7b4-2234464eed87 (e43c654c-1d31-4d92-b7b4-2234464eed87): created successfully Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c84a94-3a99-479b-a60d-3895f679a5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Flow 'volume_create_manager' (45d278b2-aac3-4390-940e-7f94142ce9a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:42 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d14f6016-ef53-438e-8615-b43412ae3a51 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created volume successfully. Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:42 devstack sudo[87644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:42 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:42 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:42 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.433s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b2759b58-72be-4115-bcf6-6066f44e9267 1073741824" returned: 0 in 0.538s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:42 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Deleted volume successfully. Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d6c829ae-0598-4516-81c1-cc290d52f297 tempest-ServersNegativeTestJSON-764240758 None] Lock "cinder-e146f179-3a06-4725-9633-ddfe8a46ab20-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b2759b58-72be-4115-bcf6-6066f44e9267 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:42 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b2759b58-72be-4115-bcf6-6066f44e9267 Apr 13 17:26:42 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Acquiring lock "cinder-15aea280-e004-4f92-9510-3c6962cb55b2-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Lock "cinder-15aea280-e004-4f92-9510-3c6962cb55b2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Acquiring lock "cinder-quobyte-15aea280-e004-4f92-9510-3c6962cb55b2" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Lock "cinder-quobyte-15aea280-e004-4f92-9510-3c6962cb55b2" acquired by "delete_volume" :: waited 0.016s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[902b4ea2-deb3-4289-93a0-ff6adde3e5ae]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-15aea280-e004-4f92-9510-3c6962cb55b2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:43 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b2759b58-72be-4115-bcf6-6066f44e9267" returned: 0 in 0.448s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.195s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2045397458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb21a7fac7a948879be230688efd2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:39Z,use_quota=True,user_id='830338098ad34d948bbcfa5875ddb56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Creating volume 8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:43 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a95b552-443e-409e-9c36-f7dc351c9382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2759b58-72be-4115-bcf6-6066f44e9267', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:43 devstack sudo[87654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e 1073741824 Apr 13 17:26:43 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619c3bb1-1d3e-4d8b-b7aa-f4f94a8a41f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:43 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume volume-b2759b58-72be-4115-bcf6-6066f44e9267 (b2759b58-72be-4115-bcf6-6066f44e9267): created successfully Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619c3bb1-1d3e-4d8b-b7aa-f4f94a8a41f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Flow 'volume_create_manager' (d01d2746-bdeb-4426-be58-20d57dd4480a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:43 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d0452cdb-1750-4e88-b176-5fbff45b0420 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created volume successfully. Apr 13 17:26:43 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-15aea280-e004-4f92-9510-3c6962cb55b2 Apr 13 17:26:43 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:43 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-15aea280-e004-4f92-9510-3c6962cb55b2" returned: 0 in 0.526s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-15aea280-e004-4f92-9510-3c6962cb55b2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:43 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-15aea280-e004-4f92-9510-3c6962cb55b2 Apr 13 17:26:43 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:43 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e 1073741824" returned: 0 in 0.524s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:43 devstack sudo[87665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e Apr 13 17:26:43 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:44 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-15aea280-e004-4f92-9510-3c6962cb55b2" returned: 0 in 0.440s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Lock "cinder-quobyte-15aea280-e004-4f92-9510-3c6962cb55b2" released by "delete_volume" :: held 0.987s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:44 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e" returned: 0 in 0.404s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.821s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1678733601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b5832b-801a-4a21-946c-657d12c22337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb21a7fac7a948879be230688efd2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:39Z,use_quota=True,user_id='830338098ad34d948bbcfa5875ddb56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Creating volume e8b5832b-801a-4a21-946c-657d12c22337 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:44 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e8b5832b-801a-4a21-946c-657d12c22337 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c8df1b-2a88-4e37-a869-08c85191af84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cacf27-6f31-4836-8bc4-f72d0cf9c2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:44 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e8b5832b-801a-4a21-946c-657d12c22337 1073741824 Apr 13 17:26:44 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:44 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e (8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e): created successfully Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cacf27-6f31-4836-8bc4-f72d0cf9c2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Flow 'volume_create_manager' (50fdd24d-a580-4095-81d9-35d289ca8c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:44 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-8cc8716d-c5c8-4b18-947d-c003c5915f69 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created volume successfully. Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Created reservations ['d3b563a8-042d-47d5-b61e-676ff20d4415', 'bd7e921c-d655-4e45-b613-6a8da5723875', '36884bc0-5a79-426a-ac60-dc8bfbcf7c20', '8cbb7645-2b98-4d75-9fdd-23bd118232ee'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:44 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:44 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:44 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e8b5832b-801a-4a21-946c-657d12c22337 1073741824" returned: 0 in 0.548s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:44 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e8b5832b-801a-4a21-946c-657d12c22337 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.465s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:44 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Deleted volume successfully. Apr 13 17:26:44 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e8b5832b-801a-4a21-946c-657d12c22337 Apr 13 17:26:44 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f45eeea6-193e-46b4-bbb1-aecbb5c626d3 tempest-ServersNegativeTestJSON-764240758 None] Lock "cinder-15aea280-e004-4f92-9510-3c6962cb55b2-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:45 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e8b5832b-801a-4a21-946c-657d12c22337" returned: 0 in 0.418s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.665s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ed8d61-c068-4af8-a90b-076659c23edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b5832b-801a-4a21-946c-657d12c22337', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca2b8b1-ff2f-41f9-a188-e42042191098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:45 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Volume volume-e8b5832b-801a-4a21-946c-657d12c22337 (e8b5832b-801a-4a21-946c-657d12c22337): created successfully Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca2b8b1-ff2f-41f9-a188-e42042191098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Flow 'volume_create_manager' (b9a4bd72-a9c9-496d-bb71-f923160a4b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] Creating offline snapshot fecad12b-9481-4324-ad19-6b2bbbd15e6c of volume b982fc14-2c85-4c8f-b8d3-7730a7a28b1e {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:26:45 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-a3abb1c3-9878-4323-a052-cd64c9da021c tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created volume successfully. Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4eb581-37b7-45f5-84e5-3b247b9cf648]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:45 devstack sudo[87681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e Apr 13 17:26:45 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:45 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" returned: 0 in 0.525s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:45 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c 1G Apr 13 17:26:45 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-e8b5832b-801a-4a21-946c-657d12c22337-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-e8b5832b-801a-4a21-946c-657d12c22337-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-quobyte-e8b5832b-801a-4a21-946c-657d12c22337" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-e8b5832b-801a-4a21-946c-657d12c22337" acquired by "delete_volume" :: waited 0.007s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad4a9da-c942-4d32-b634-be174bc4a0ce]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e8b5832b-801a-4a21-946c-657d12c22337 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:46 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e8b5832b-801a-4a21-946c-657d12c22337 Apr 13 17:26:46 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:46 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c 1G" returned: 0 in 0.527s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:46 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c Apr 13 17:26:46 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:46 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e8b5832b-801a-4a21-946c-657d12c22337" returned: 0 in 0.541s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e8b5832b-801a-4a21-946c-657d12c22337 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:46 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e8b5832b-801a-4a21-946c-657d12c22337 Apr 13 17:26:46 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:46 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c" returned: 0 in 0.615s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:46 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c is being set with open permissions: ugo+rw Apr 13 17:26:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:47 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c Apr 13 17:26:47 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:47 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e8b5832b-801a-4a21-946c-657d12c22337" returned: 0 in 0.640s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-e8b5832b-801a-4a21-946c-657d12c22337" released by "delete_volume" :: held 1.210s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created reservations ['9ed97fff-5ad0-4d32-8ec2-9fdc6f9875e1', 'c2127824-7505-446f-a9b2-efa2717c41db', '863c9dda-5e7c-4042-a330-acfe30475b5b', '88255584-6796-47f4-88f8-46629feb1738'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:47 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:47 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:47 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c" returned: 0 in 0.507s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:47 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.info Apr 13 17:26:47 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:47 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.420s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:47 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Deleted volume successfully. Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c3cf8678-5768-4f2f-a71a-57a205759a07 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-e8b5832b-801a-4a21-946c-657d12c22337-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:47 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.info" returned: 0 in 0.451s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:47 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.info is being set with open permissions: ugo+rw Apr 13 17:26:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:47 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.info Apr 13 17:26:47 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-quobyte-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bf30b7-7cf2-4760-8940-93f3f1ccdd31]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:48 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e Apr 13 17:26:48 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:48 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.info" returned: 0 in 0.603s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.322s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.222s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1846400685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d410274-6c2b-4b36-bca4-5305a8e52728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef48253aab9407c8133c4158e85d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:41Z,use_quota=True,user_id='9214eb1dfd8c4b85bfa34a039043c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Creating volume 9d410274-6c2b-4b36-bca4-5305a8e52728 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:48 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d410274-6c2b-4b36-bca4-5305a8e52728 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:48 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d410274-6c2b-4b36-bca4-5305a8e52728 1073741824 Apr 13 17:26:48 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:48 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-2d06092e-fa87-4b52-b624-98899088327d tempest-VolumesDeleteCascade-1058011805 None] Create snapshot completed successfully Apr 13 17:26:48 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e" returned: 0 in 0.532s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:48 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e Apr 13 17:26:48 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:49 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d410274-6c2b-4b36-bca4-5305a8e52728 1073741824" returned: 0 in 0.590s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d410274-6c2b-4b36-bca4-5305a8e52728 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:49 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d410274-6c2b-4b36-bca4-5305a8e52728 Apr 13 17:26:49 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:49 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e" returned: 0 in 0.524s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Flow 'volume_create_manager' (fa5f34bf-3502-4e9c-9de2-8a3dadb3fd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a889d44-6c44-45cb-8bac-80a071534aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e" released by "delete_volume" :: held 1.109s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a889d44-6c44-45cb-8bac-80a071534aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2138802348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f369ed-22e8-44d2-ae90-b1d31b0f94fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5a0c2f1cc14f2394b880f5c595b760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fecad12b-9481-4324-ad19-6b2bbbd15e6c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:49Z,use_quota=True,user_id='86855a2632bd4b37b7fd9b0e0fab84d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233709ea-e67e-45c7-b509-86d5f49f7b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233709ea-e67e-45c7-b509-86d5f49f7b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd12c9c-e298-42f9-b38e-4c774bc6cd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd12c9c-e298-42f9-b38e-4c774bc6cd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '72f369ed-22e8-44d2-ae90-b1d31b0f94fc', 'volume_name': 'volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc', 'volume_size': 1, 'snapshot_id': 'fecad12b-9481-4324-ad19-6b2bbbd15e6c'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503b3c83-f96a-4505-b1b8-9f47cd329e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503b3c83-f96a-4505-b1b8-9f47cd329e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4abdde-6efa-4db3-be1c-0760bf8187fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:49 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Volume 72f369ed-22e8-44d2-ae90-b1d31b0f94fc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc', 'volume_size': 1, 'snapshot_id': 'fecad12b-9481-4324-ad19-6b2bbbd15e6c'} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created reservations ['f279560d-faa9-481c-a879-7d090b3f3843', '601632cd-3906-43d6-a3ad-1ebf7f3a9ca4', '41c5ad26-7e70-4fbb-aa70-6e0af22bdf87', 'cceab966-ab15-4676-ac33-a560d0158f87'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:49 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:49 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:49 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d410274-6c2b-4b36-bca4-5305a8e52728" returned: 0 in 0.510s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.352s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-quobyte-fecad12b-9481-4324-ad19-6b2bbbd15e6c-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" by "_create_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:UPDATE=202,cinder:SELECT=138,cinder:INSERT=38,cinder:DELETE=19 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5067aba3-0fe4-46bf-8de6-cfa7e7e2aa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d410274-6c2b-4b36-bca4-5305a8e52728', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c835a4a4-21dd-48b4-be10-fd60011abc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-fecad12b-9481-4324-ad19-6b2bbbd15e6c-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Creating volume 72f369ed-22e8-44d2-ae90-b1d31b0f94fc from snapshot fecad12b-9481-4324-ad19-6b2bbbd15e6c {{(pid=81998) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-quobyte-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:DELETE=17,cinder:SELECT=160,cinder:INSERT=57,cinder:UPDATE=199 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:26:49 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Volume volume-9d410274-6c2b-4b36-bca4-5305a8e52728 (9d410274-6c2b-4b36-bca4-5305a8e52728): created successfully Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c835a4a4-21dd-48b4-be10-fd60011abc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Flow 'volume_create_manager' (86afe1b4-9ba4-45a7-8cca-f81c774f00d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:49 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-9b4c4932-ec8f-4df2-88dd-04ec312cf622 tempest-VolumesActionsTest-1123284758 None] Created volume successfully. Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] snapshot: fecad12b-9481-4324-ad19-6b2bbbd15e6c, volume: 72f369ed-22e8-44d2-ae90-b1d31b0f94fc, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79729f4-8419-48e2-9f49-1aa645e6d4a9]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:49 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c Apr 13 17:26:49 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:49 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.471s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:49 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Deleted volume successfully. Apr 13 17:26:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-24723a5f-4125-4ef8-8bf7-ae809b508a81 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-8e0885d4-e4e6-4c72-ab74-7ae5b7c38f3e-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-b2759b58-72be-4115-bcf6-6066f44e9267-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:50 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-b2759b58-72be-4115-bcf6-6066f44e9267-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c" returned: 0 in 0.528s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[715b8a59-2f7f-4d5d-8b6c-4e2817783e53]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-quobyte-b2759b58-72be-4115-bcf6-6066f44e9267" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-b2759b58-72be-4115-bcf6-6066f44e9267" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa64a09-8565-4ae5-bd24-2abdb1f2e8e2]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b2759b58-72be-4115-bcf6-6066f44e9267 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:50 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e Apr 13 17:26:50 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:50 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b2759b58-72be-4115-bcf6-6066f44e9267 Apr 13 17:26:50 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Acquiring lock "cinder-9d410274-6c2b-4b36-bca4-5305a8e52728-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Lock "cinder-9d410274-6c2b-4b36-bca4-5305a8e52728-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Acquiring lock "cinder-quobyte-9d410274-6c2b-4b36-bca4-5305a8e52728" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Lock "cinder-quobyte-9d410274-6c2b-4b36-bca4-5305a8e52728" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[134c0c76-2959-4dab-865c-28d4a239760b]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d410274-6c2b-4b36-bca4-5305a8e52728 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:50 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b2759b58-72be-4115-bcf6-6066f44e9267" returned: 0 in 0.567s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b2759b58-72be-4115-bcf6-6066f44e9267 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:50 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:50 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d410274-6c2b-4b36-bca4-5305a8e52728 Apr 13 17:26:50 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" returned: 0 in 0.621s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:26:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:50 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b2759b58-72be-4115-bcf6-6066f44e9267 Apr 13 17:26:51 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:51 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc Apr 13 17:26:51 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:51 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d410274-6c2b-4b36-bca4-5305a8e52728" returned: 0 in 0.489s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d410274-6c2b-4b36-bca4-5305a8e52728 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:51 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b2759b58-72be-4115-bcf6-6066f44e9267" returned: 0 in 0.458s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:51 devstack sudo[87796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d410274-6c2b-4b36-bca4-5305a8e52728 Apr 13 17:26:51 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-b2759b58-72be-4115-bcf6-6066f44e9267" released by "delete_volume" :: held 1.060s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:51 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created reservations ['bd09924a-9054-4cab-ae89-a7b2b353108c', '6a296d52-123b-4b14-a4b8-21d21252f148', 'b891b32f-bb39-4a58-b86c-a7eb1191ab0a', '3b1bf395-b1d2-4ebb-9e65-b35e7c403a36'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:51 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:51 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-e43c654c-1d31-4d92-b7b4-2234464eed87-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-e43c654c-1d31-4d92-b7b4-2234464eed87-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-quobyte-e43c654c-1d31-4d92-b7b4-2234464eed87" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-e43c654c-1d31-4d92-b7b4-2234464eed87" acquired by "delete_volume" :: waited 0.032s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:52 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d410274-6c2b-4b36-bca4-5305a8e52728" returned: 0 in 1.472s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:52 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba458355-c808-49e0-9402-235676f977cf]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e43c654c-1d31-4d92-b7b4-2234464eed87 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Lock "cinder-quobyte-9d410274-6c2b-4b36-bca4-5305a8e52728" released by "delete_volume" :: held 2.025s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Created reservations ['8f990995-6e78-49d9-8ff7-f8ec48572c01', '0a5288b1-f8e0-4371-b771-475ea632c5e3', '05124775-c015-4904-9947-4fa056a49371', '1831b480-cc11-4471-b257-4bf2be2a4b3a'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:53 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e43c654c-1d31-4d92-b7b4-2234464eed87 Apr 13 17:26:53 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:53 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:53 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:53 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 2.005s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:53 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Deleted volume successfully. Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c6b71579-71ac-4c07-95e9-f534f2502701 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-b2759b58-72be-4115-bcf6-6066f44e9267-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:53 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" returned: 0 in 2.756s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9290400-2ee2-4e96-a2ee-aeaaa07cc64f]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:53 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e Apr 13 17:26:53 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:54 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.686s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:54 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:54 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Deleted volume successfully. Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e43c654c-1d31-4d92-b7b4-2234464eed87" returned: 0 in 1.202s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e43c654c-1d31-4d92-b7b4-2234464eed87 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-43c45de1-27fc-4c7d-bfce-dc2b743b3469 tempest-VolumesActionsTest-688251563 None] Lock "cinder-9d410274-6c2b-4b36-bca4-5305a8e52728-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:54 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e43c654c-1d31-4d92-b7b4-2234464eed87 Apr 13 17:26:54 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:54 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" returned: 0 in 0.744s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e, size 1024.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:26:54 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Converted 1024.00 MB image at 371.47 MB/s Apr 13 17:26:54 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc is being set with open permissions: ugo+rw Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:54 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc Apr 13 17:26:54 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:54 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e43c654c-1d31-4d92-b7b4-2234464eed87" returned: 0 in 0.527s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-e43c654c-1d31-4d92-b7b4-2234464eed87" released by "delete_volume" :: held 1.789s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created reservations ['50dc899e-8dff-4172-827e-6a1bc54cab9c', '55842a97-07eb-41be-b35c-b23665edf555', 'fe6e7551-4908-44fe-ac88-0d6b4123e18f', '45cb2c5f-6bbf-42ce-935f-1f59c1ef236a'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:54 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:54 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Flow 'volume_create_manager' (17a5c68f-a965-4dfc-8585-5af80fc5158e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637f1536-8126-4705-87be-51a7162b5d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637f1536-8126-4705-87be-51a7162b5d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-677611314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62ff5e4-1142-40c2-9f4b-eb87c5367c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef48253aab9407c8133c4158e85d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:55Z,use_quota=True,user_id='9214eb1dfd8c4b85bfa34a039043c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561f9ba0-d9c3-45a9-93d9-ff91529bb8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561f9ba0-d9c3-45a9-93d9-ff91529bb8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d314923c-fa9c-4373-a8a5-ec41664a9123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d314923c-fa9c-4373-a8a5-ec41664a9123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62ff5e4-1142-40c2-9f4b-eb87c5367c7f', 'volume_name': 'volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84ed044-6413-43cf-90c1-17502506fb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84ed044-6413-43cf-90c1-17502506fb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ec7329-9840-4889-a121-e790bd336688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:54 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Volume d62ff5e4-1142-40c2-9f4b-eb87c5367c7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f', 'volume_size': 1} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-45fa7741-e66a-421c-b2e9-fe45d75c1a8a-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-45fa7741-e66a-421c-b2e9-fe45d75c1a8a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-quobyte-45fa7741-e66a-421c-b2e9-fe45d75c1a8a" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-45fa7741-e66a-421c-b2e9-fe45d75c1a8a" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe6034e-49de-4a57-8e0c-ad09ad938c7e]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:55 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" returned: 0 in 0.571s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" released by "_copy_volume_from_snapshot" :: held 5.292s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-fecad12b-9481-4324-ad19-6b2bbbd15e6c-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" released by "_create_volume_from_snapshot" :: held 5.334s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.361s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.179s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-677611314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62ff5e4-1142-40c2-9f4b-eb87c5367c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef48253aab9407c8133c4158e85d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:55Z,use_quota=True,user_id='9214eb1dfd8c4b85bfa34a039043c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Creating volume d62ff5e4-1142-40c2-9f4b-eb87c5367c7f {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:55 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4abdde-6efa-4db3-be1c-0760bf8187fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc', 'volume_size': 1, 'snapshot_id': 'fecad12b-9481-4324-ad19-6b2bbbd15e6c'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e2893e-cfff-4a37-b083-802af4ff2949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:55 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f 1073741824 Apr 13 17:26:55 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a Apr 13 17:26:55 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:55 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:55 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Volume volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc (72f369ed-22e8-44d2-ae90-b1d31b0f94fc): created successfully Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e2893e-cfff-4a37-b083-802af4ff2949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Flow 'volume_create_manager' (fa5f34bf-3502-4e9c-9de2-8a3dadb3fd71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:55 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-6a6648d7-2ad7-4115-b0f1-a3aa549566bc tempest-VolumesDeleteCascade-1058011805 None] Created volume successfully. Apr 13 17:26:55 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.566s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:55 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Deleted volume successfully. Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-90943fe1-1403-4f29-bbf9-8b4c9bcb5dc0 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-e43c654c-1d31-4d92-b7b4-2234464eed87-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:55 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a" returned: 0 in 0.647s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:55 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a Apr 13 17:26:55 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:55 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f 1073741824" returned: 0 in 0.642s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:55 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f Apr 13 17:26:55 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Performing cascade delete. {{(pid=81998) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-fecad12b-9481-4324-ad19-6b2bbbd15e6c-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-fecad12b-9481-4324-ad19-6b2bbbd15e6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-quobyte-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-quobyte-fecad12b-9481-4324-ad19-6b2bbbd15e6c" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-fecad12b-9481-4324-ad19-6b2bbbd15e6c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Deleting offline snapshot fecad12b-9481-4324-ad19-6b2bbbd15e6c of volume b982fc14-2c85-4c8f-b8d3-7730a7a28b1e {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] snapshot_file for this snap is: volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ba4097-c952-488d-9ffd-88c84c0d5b35]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:56 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c Apr 13 17:26:56 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:56 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-45fa7741-e66a-421c-b2e9-fe45d75c1a8a" returned: 0 in 0.592s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-45fa7741-e66a-421c-b2e9-fe45d75c1a8a" released by "delete_volume" :: held 1.266s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:56 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f" returned: 0 in 0.596s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ec7329-9840-4889-a121-e790bd336688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa3d42f-1fda-4f0a-959d-74beb1ad10ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created reservations ['c3331957-8a8e-4234-8a8f-eddf2b49af9c', '8ad72041-508d-4679-b01f-fc7404929d9c', '82da42f0-6e4a-4a9b-a9d7-0eef7b4e2552', 'b365a87e-954b-4128-9012-b658cc809d6a'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:56 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Volume volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f (d62ff5e4-1142-40c2-9f4b-eb87c5367c7f): created successfully Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa3d42f-1fda-4f0a-959d-74beb1ad10ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Flow 'volume_create_manager' (17a5c68f-a965-4dfc-8585-5af80fc5158e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:56 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-4e09d097-52b5-431b-b685-794da1406242 tempest-VolumesActionsTest-1123284758 None] Created volume successfully. Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:56 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:56 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:56 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c" returned: 0 in 0.604s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[53345a7b-0377-4e7a-97ce-0b1f38f0bb93]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:56 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e Apr 13 17:26:56 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:56 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Acquiring lock "cinder-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Lock "cinder-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Acquiring lock "cinder-quobyte-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Lock "cinder-quobyte-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f" acquired by "delete_volume" :: waited 0.024s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c65e20-4de4-45d6-b280-43007118a2e2]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-439b8a33-f62d-452e-8a36-023f43aa7afe-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:57 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f Apr 13 17:26:57 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-439b8a33-f62d-452e-8a36-023f43aa7afe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-quobyte-4d895f87-1766-4dac-a41c-a0b79fc3a2ef" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-4d895f87-1766-4dac-a41c-a0b79fc3a2ef" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-quobyte-439b8a33-f62d-452e-8a36-023f43aa7afe" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-439b8a33-f62d-452e-8a36-023f43aa7afe" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:57 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Deleting offline snapshot 439b8a33-f62d-452e-8a36-023f43aa7afe of volume 4d895f87-1766-4dac-a41c-a0b79fc3a2ef {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] snapshot_file for this snap is: volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.636s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:57 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Deleted volume successfully. Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0789ce-1a93-474c-8164-72a03e23cf4a]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-246da470-7750-4774-ae25-73cde3e8b755 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-45fa7741-e66a-421c-b2e9-fe45d75c1a8a-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:57 devstack sudo[87863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe Apr 13 17:26:57 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:57 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" returned: 0 in 0.818s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:57 devstack sudo[87868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c Apr 13 17:26:57 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:57 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f" returned: 0 in 0.601s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:57 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f Apr 13 17:26:57 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:57 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe" returned: 0 in 0.603s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[739a14ff-79d6-4e98-a07a-6e39216b466f]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:57 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef Apr 13 17:26:57 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:58 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c" returned: 0 in 0.524s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:58 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c Apr 13 17:26:58 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:58 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f" returned: 0 in 0.506s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Lock "cinder-quobyte-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f" released by "delete_volume" :: held 1.137s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Created reservations ['18d6c2c8-e438-48ef-8542-448f6acaeec9', 'be10e87d-47b8-4b7a-848f-9c268523541e', '7f34315c-c401-44aa-ab30-1b36eec269a6', 'df42550e-ecaf-4e53-8ca5-b516580c40a4'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:58 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:58 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:58 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e.fecad12b-9481-4324-ad19-6b2bbbd15e6c" returned: 0 in 0.511s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:58 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef" returned: 0 in 0.665s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-fecad12b-9481-4324-ad19-6b2bbbd15e6c" released by "_delete_snapshot" :: held 2.521s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" released by "delete_snapshot" :: held 2.536s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:58 devstack sudo[87892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe Apr 13 17:26:58 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Created reservations ['8ff974b7-68a3-4eb1-aa03-6c38f7894c30', '3594814e-b926-47f7-8c9e-469a1ab44374', '0f9fa668-6d83-4d4c-9a7f-43dc4c7e58fe', 'd0b56377-b64d-4b20-800a-5170fdea3f5d'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:58 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Delete snapshot completed successfully. Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-fecad12b-9481-4324-ad19-6b2bbbd15e6c-delete_snapshot" released by "delete_snapshot" :: held 2.687s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Snapshots deleted, issuing volume delete {{(pid=81998) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-quobyte-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" acquired by "delete_volume" :: waited 0.023s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9214cf-9410-4110-b994-f4bf5832d6d5]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:58 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Flow 'volume_create_manager' (041bef68-0015-456e-a3f4-7dfdac4c9842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437c0b5a-0855-448a-a599-9239265ccc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.477s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437c0b5a-0855-448a-a599-9239265ccc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1215968043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d61b32-dc7a-4044-acf3-8bc79436b62b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a02d046059fe43b9bac107573037d748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:59Z,use_quota=True,user_id='613b8f6db2704c669a505bff527949f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48892b7-5362-4b75-b718-e2106c938ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48892b7-5362-4b75-b718-e2106c938ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc048cb-6a8f-44da-ba2d-0efade6201e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:58 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e Apr 13 17:26:58 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc048cb-6a8f-44da-ba2d-0efade6201e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d61b32-dc7a-4044-acf3-8bc79436b62b', 'volume_name': 'volume-17d61b32-dc7a-4044-acf3-8bc79436b62b', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702a512d-be9f-4161-b837-901ad2db9359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702a512d-be9f-4161-b837-901ad2db9359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc39b074-68e7-43c0-89ce-9c27d19b0a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:58 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Volume 17d61b32-dc7a-4044-acf3-8bc79436b62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d61b32-dc7a-4044-acf3-8bc79436b62b', 'volume_size': 1} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1215968043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d61b32-dc7a-4044-acf3-8bc79436b62b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a02d046059fe43b9bac107573037d748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:26:59Z,use_quota=True,user_id='613b8f6db2704c669a505bff527949f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Creating volume 17d61b32-dc7a-4044-acf3-8bc79436b62b {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:26:58 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d61b32-dc7a-4044-acf3-8bc79436b62b 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:58 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Deleted volume successfully. Apr 13 17:26:58 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d61b32-dc7a-4044-acf3-8bc79436b62b 1073741824 Apr 13 17:26:58 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:58 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d3dc4ff2-f7e8-42f5-880b-0d7349be0e47 tempest-VolumesActionsTest-688251563 None] Lock "cinder-d62ff5e4-1142-40c2-9f4b-eb87c5367c7f-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:59 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe" returned: 0 in 0.577s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:59 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe Apr 13 17:26:59 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:59 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" returned: 0 in 0.572s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:59 devstack sudo[87910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e Apr 13 17:26:59 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:59 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d61b32-dc7a-4044-acf3-8bc79436b62b 1073741824" returned: 0 in 0.605s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d61b32-dc7a-4044-acf3-8bc79436b62b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:59 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d61b32-dc7a-4044-acf3-8bc79436b62b Apr 13 17:26:59 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Flow 'volume_create_manager' (c467a00e-a1c6-4ee9-88d3-5934c24cae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891ce504-ca41-495a-8a02-fc1ead64f011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891ce504-ca41-495a-8a02-fc1ead64f011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-215585843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d566a90-aaee-472e-a5cc-a72095e1978d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef48253aab9407c8133c4158e85d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:00Z,use_quota=True,user_id='9214eb1dfd8c4b85bfa34a039043c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65aba7ab-513f-4a6b-9280-aa10f36479fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65aba7ab-513f-4a6b-9280-aa10f36479fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa80f89-fd2a-4b60-b838-6c1ed7eb5071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa80f89-fd2a-4b60-b838-6c1ed7eb5071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d566a90-aaee-472e-a5cc-a72095e1978d', 'volume_name': 'volume-1d566a90-aaee-472e-a5cc-a72095e1978d', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986d6eec-42c0-4766-82d4-588be9a7decc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986d6eec-42c0-4766-82d4-588be9a7decc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6397469-0d44-4f46-835d-de3197447e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:26:59 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Volume 1d566a90-aaee-472e-a5cc-a72095e1978d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d566a90-aaee-472e-a5cc-a72095e1978d', 'volume_size': 1} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:59 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef.439b8a33-f62d-452e-8a36-023f43aa7afe" returned: 0 in 0.628s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:59 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-439b8a33-f62d-452e-8a36-023f43aa7afe" released by "_delete_snapshot" :: held 2.557s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" returned: 0 in 0.455s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-4d895f87-1766-4dac-a41c-a0b79fc3a2ef" released by "delete_snapshot" :: held 2.581s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e" released by "delete_volume" :: held 1.080s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Created reservations ['e6cb680a-c10a-46f0-9887-69b4275ec4ee', '194911a1-8ca9-400e-9c05-e8c79ffd767b', '984ef2fd-edde-4d1c-aaac-454ce599563b', '7d56a568-f69c-4a63-a1a0-8895e2cf6240'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created reservations ['2f3ac4bf-ed26-44f5-a63a-4a8b1cce1321', '0395bf62-0fca-43d0-94a3-d252a3267853', '9447630a-ac74-4297-a049-d200df57f95f', 'cc193211-cded-43fa-8344-fac59e06fe5c'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:26:59 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Delete snapshot completed successfully. Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8e646c0e-b572-4086-aea3-ef388cd664e2 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-439b8a33-f62d-452e-8a36-023f43aa7afe-delete_snapshot" released by "delete_snapshot" :: held 2.702s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:26:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:26:59 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:26:59 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:00 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d61b32-dc7a-4044-acf3-8bc79436b62b" returned: 0 in 0.522s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-215585843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d566a90-aaee-472e-a5cc-a72095e1978d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef48253aab9407c8133c4158e85d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:00Z,use_quota=True,user_id='9214eb1dfd8c4b85bfa34a039043c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Creating volume 1d566a90-aaee-472e-a5cc-a72095e1978d {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:00 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1d566a90-aaee-472e-a5cc-a72095e1978d 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc39b074-68e7-43c0-89ce-9c27d19b0a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d61b32-dc7a-4044-acf3-8bc79436b62b', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:00 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1d566a90-aaee-472e-a5cc-a72095e1978d 1073741824 Apr 13 17:27:00 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d03a407-8697-4912-bc26-1d875c4b95a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:00 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Volume volume-17d61b32-dc7a-4044-acf3-8bc79436b62b (17d61b32-dc7a-4044-acf3-8bc79436b62b): created successfully Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d03a407-8697-4912-bc26-1d875c4b95a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Flow 'volume_create_manager' (041bef68-0015-456e-a3f4-7dfdac4c9842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:00 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-3f33385d-e4db-4b97-8b48-f13c9aa80151 req-d6f2c8f3-62d7-4bcd-84f0-5046108aa094 tempest-VolumesGetTestJSON-1587644371 None] Created volume successfully. Apr 13 17:27:00 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.442s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:00 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Deleted volume successfully. Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f670202f-5a92-4ddc-aa33-bdec8c0e75d5 tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-b982fc14-2c85-4c8f-b8d3-7730a7a28b1e-delete_volume" released by "delete_volume" :: held 4.452s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-72f369ed-22e8-44d2-ae90-b1d31b0f94fc-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-72f369ed-22e8-44d2-ae90-b1d31b0f94fc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-4d895f87-1766-4dac-a41c-a0b79fc3a2ef-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-4d895f87-1766-4dac-a41c-a0b79fc3a2ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "cinder-quobyte-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" acquired by "delete_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1dd91f-5b8b-43b3-bdab-87fc9327c2b8]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "cinder-quobyte-4d895f87-1766-4dac-a41c-a0b79fc3a2ef" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-4d895f87-1766-4dac-a41c-a0b79fc3a2ef" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b6686f-ccf3-4c35-ab93-ed571a6ba405]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:00 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc Apr 13 17:27:00 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:00 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef Apr 13 17:27:00 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:00 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1d566a90-aaee-472e-a5cc-a72095e1978d 1073741824" returned: 0 in 0.621s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1d566a90-aaee-472e-a5cc-a72095e1978d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:00 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1d566a90-aaee-472e-a5cc-a72095e1978d Apr 13 17:27:00 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Acquiring lock "cinder-17d61b32-dc7a-4044-acf3-8bc79436b62b-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Lock "cinder-17d61b32-dc7a-4044-acf3-8bc79436b62b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:01 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Acquiring lock "cinder-quobyte-17d61b32-dc7a-4044-acf3-8bc79436b62b" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" returned: 0 in 0.633s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Lock "cinder-quobyte-17d61b32-dc7a-4044-acf3-8bc79436b62b" acquired by "delete_volume" :: waited 0.022s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:01 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef" returned: 0 in 0.604s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:01 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:01 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad2e18b-2f35-4241-904b-a5fe209bdc95]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d61b32-dc7a-4044-acf3-8bc79436b62b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:01 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef Apr 13 17:27:01 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:01 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1d566a90-aaee-472e-a5cc-a72095e1978d" returned: 0 in 0.515s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6397469-0d44-4f46-835d-de3197447e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d566a90-aaee-472e-a5cc-a72095e1978d', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33262722-7258-42eb-bc21-c98549870e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:01 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Volume volume-1d566a90-aaee-472e-a5cc-a72095e1978d (1d566a90-aaee-472e-a5cc-a72095e1978d): created successfully Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33262722-7258-42eb-bc21-c98549870e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Flow 'volume_create_manager' (c467a00e-a1c6-4ee9-88d3-5934c24cae9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:01 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-cce40f41-b2dd-47e9-9422-a73e4001f044 tempest-VolumesActionsTest-1123284758 None] Created volume successfully. Apr 13 17:27:01 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d61b32-dc7a-4044-acf3-8bc79436b62b Apr 13 17:27:01 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:01 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" returned: 0 in 0.468s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-quobyte-72f369ed-22e8-44d2-ae90-b1d31b0f94fc" released by "delete_volume" :: held 1.138s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Created reservations ['252f7ea8-102c-45ec-b3dc-81ba350a2874', 'a99e7639-5a6a-468a-8ca2-8737dfa03f64', '84e7df03-8c8f-4d96-bbe1-ca38e1e7d19c', '2ebc8b97-e161-4207-9ff7-91e17366e67d'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:01 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4d895f87-1766-4dac-a41c-a0b79fc3a2ef" returned: 0 in 0.560s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-quobyte-4d895f87-1766-4dac-a41c-a0b79fc3a2ef" released by "delete_volume" :: held 1.217s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:01 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d61b32-dc7a-4044-acf3-8bc79436b62b" returned: 0 in 0.597s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d61b32-dc7a-4044-acf3-8bc79436b62b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:01 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:01 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:01 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d61b32-dc7a-4044-acf3-8bc79436b62b Apr 13 17:27:01 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Acquiring lock "cinder-1d566a90-aaee-472e-a5cc-a72095e1978d-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Created reservations ['0e75c17e-008c-4b9e-99a1-8c50f5c9dc60', '3fba5ca2-6d75-4648-b3af-b8c832a672c5', 'cfbcafcb-8bec-40a6-a9c3-293a473cf6cc', '68da66e8-2b5e-49f8-9bed-2b3d79d43314'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Lock "cinder-1d566a90-aaee-472e-a5cc-a72095e1978d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Acquiring lock "cinder-quobyte-1d566a90-aaee-472e-a5cc-a72095e1978d" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Lock "cinder-quobyte-1d566a90-aaee-472e-a5cc-a72095e1978d" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4daef55-3cf3-473a-ba45-1f23c51475df]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1d566a90-aaee-472e-a5cc-a72095e1978d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:01 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:01 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:02 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1d566a90-aaee-472e-a5cc-a72095e1978d Apr 13 17:27:02 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:02 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-17d61b32-dc7a-4044-acf3-8bc79436b62b" returned: 0 in 0.474s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Lock "cinder-quobyte-17d61b32-dc7a-4044-acf3-8bc79436b62b" released by "delete_volume" :: held 1.105s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:02 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.550s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG cinder.quota [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Created reservations ['a2abd806-fa77-40de-a405-1f2884f8f977', '6590b018-8904-4993-933c-51957b29d24b', '2ee6ae6b-217a-41a8-bb5c-66fbb649b184', '6d04d881-fe8f-49aa-817a-187febfed2b8'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Deleted volume successfully. Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-647c3097-2359-4207-aebd-3f97c88cb2de tempest-VolumesDeleteCascade-1058011805 None] Lock "cinder-72f369ed-22e8-44d2-ae90-b1d31b0f94fc-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:02 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:02 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:02 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1d566a90-aaee-472e-a5cc-a72095e1978d" returned: 0 in 0.504s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1d566a90-aaee-472e-a5cc-a72095e1978d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:02 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.497s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Deleted volume successfully. Apr 13 17:27:02 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1d566a90-aaee-472e-a5cc-a72095e1978d Apr 13 17:27:02 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-270cfd3a-9866-445a-9155-fedc0c078f50 tempest-CreateVolumesFromSnapshotTest-1375195545 None] Lock "cinder-4d895f87-1766-4dac-a41c-a0b79fc3a2ef-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:02 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.501s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG cinder.manager [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Deleted volume successfully. Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [req-82c7b2b9-e35c-4dad-bfb1-31ef2fa5e43e req-93083e6c-a1fc-41bd-b08e-033012ef0c58 tempest-VolumesGetTestJSON-1587644371 None] Lock "cinder-17d61b32-dc7a-4044-acf3-8bc79436b62b-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:02 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1d566a90-aaee-472e-a5cc-a72095e1978d" returned: 0 in 0.536s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Lock "cinder-quobyte-1d566a90-aaee-472e-a5cc-a72095e1978d" released by "delete_volume" :: held 1.067s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:03 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Created reservations ['eefed9c5-5339-4554-8b0e-0afe8d763293', '462ec743-2a33-4e54-ad6d-7b27946004af', '91c6e7ad-d3b1-4604-bf49-c53f95a4c66c', '68612c35-6a91-48b5-a74a-aa55fa46d4fb'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:03 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:03 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:03 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.567s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:03 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:03 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Deleted volume successfully. Apr 13 17:27:03 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-318f339f-e081-4c41-ac91-d521734095d5 tempest-VolumesActionsTest-688251563 None] Lock "cinder-1d566a90-aaee-472e-a5cc-a72095e1978d-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Flow 'volume_create_manager' (bbc9463c-8955-4917-a382-7271d0dee509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1717267-704b-4995-96fb-2270eb1b0777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1717267-704b-4995-96fb-2270eb1b0777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1085635919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27d0333-184d-4443-ae9e-70df9ad21cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef48253aab9407c8133c4158e85d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:04Z,use_quota=True,user_id='9214eb1dfd8c4b85bfa34a039043c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d3a59a-d4d4-44f2-a217-4af2d3db6d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d3a59a-d4d4-44f2-a217-4af2d3db6d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0f8b06-4231-46e1-8823-15d62b17ab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0f8b06-4231-46e1-8823-15d62b17ab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f27d0333-184d-4443-ae9e-70df9ad21cc2', 'volume_name': 'volume-f27d0333-184d-4443-ae9e-70df9ad21cc2', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd39e88d-dc8f-4500-ac10-edbf4806723e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd39e88d-dc8f-4500-ac10-edbf4806723e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3fd3f5-f977-4aa2-8ab4-d41cead5c7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:04 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Volume f27d0333-184d-4443-ae9e-70df9ad21cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f27d0333-184d-4443-ae9e-70df9ad21cc2', 'volume_size': 1} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1085635919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27d0333-184d-4443-ae9e-70df9ad21cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef48253aab9407c8133c4158e85d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:04Z,use_quota=True,user_id='9214eb1dfd8c4b85bfa34a039043c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Creating volume f27d0333-184d-4443-ae9e-70df9ad21cc2 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:04 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:27:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f27d0333-184d-4443-ae9e-70df9ad21cc2 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:04 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f27d0333-184d-4443-ae9e-70df9ad21cc2 1073741824 Apr 13 17:27:04 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Flow 'volume_create_manager' (a747bee7-457b-4f44-b20e-c88c4439796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e560c874-0bb8-417f-8f66-d4acdf31491d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e560c874-0bb8-417f-8f66-d4acdf31491d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1272763080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a40502-221e-4d9f-9983-7c18e4157795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5abc751a5e418c9fde74b4ccf22a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:05Z,use_quota=True,user_id='c8a6eeb90f4348d591e6e4d7963cef16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0bd85a-eedd-4e68-a95e-413bbd7d0ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0bd85a-eedd-4e68-a95e-413bbd7d0ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:05 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756e3e2b-419e-436d-b752-c0d7ddd422fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756e3e2b-419e-436d-b752-c0d7ddd422fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a40502-221e-4d9f-9983-7c18e4157795', 'volume_name': 'volume-78a40502-221e-4d9f-9983-7c18e4157795', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71fdeb2-a064-4449-8c94-9c96cb28b834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71fdeb2-a064-4449-8c94-9c96cb28b834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b731d4e9-812c-45f4-8e07-fe42875db322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:05 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Volume 78a40502-221e-4d9f-9983-7c18e4157795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a40502-221e-4d9f-9983-7c18e4157795', 'volume_size': 1} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f27d0333-184d-4443-ae9e-70df9ad21cc2 1073741824" returned: 0 in 0.680s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Flow 'volume_create_manager' (8d9cb3da-2c76-490c-9e6c-f6387e57b4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50403391-a4fa-49b8-a1d3-1ba4ecfe49f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50403391-a4fa-49b8-a1d3-1ba4ecfe49f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-211177013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fca12d-31fd-4a18-b06a-97f6e48ec677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0e16bf7e54aeba3924a8f82a1d5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:05Z,use_quota=True,user_id='4216ddff5d834da28163f3142f3e2325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ad68e2-e23c-4f47-b5e8-50b729f30085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ad68e2-e23c-4f47-b5e8-50b729f30085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d21f9b-525e-4c2e-8992-93dbfc9e8d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d21f9b-525e-4c2e-8992-93dbfc9e8d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0fca12d-31fd-4a18-b06a-97f6e48ec677', 'volume_name': 'volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b800ae-7cb8-4404-9a82-1a00a034348b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b800ae-7cb8-4404-9a82-1a00a034348b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af0977d-c4af-4a8a-b80b-2d68fccf99ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:05 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Volume a0fca12d-31fd-4a18-b06a-97f6e48ec677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677', 'volume_size': 1} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f27d0333-184d-4443-ae9e-70df9ad21cc2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:05 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f27d0333-184d-4443-ae9e-70df9ad21cc2 Apr 13 17:27:05 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:05 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f27d0333-184d-4443-ae9e-70df9ad21cc2" returned: 0 in 0.495s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1272763080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a40502-221e-4d9f-9983-7c18e4157795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5abc751a5e418c9fde74b4ccf22a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:05Z,use_quota=True,user_id='c8a6eeb90f4348d591e6e4d7963cef16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Creating volume 78a40502-221e-4d9f-9983-7c18e4157795 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:05 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3fd3f5-f977-4aa2-8ab4-d41cead5c7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f27d0333-184d-4443-ae9e-70df9ad21cc2', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:05 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 1073741824 Apr 13 17:27:05 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ec19a0-df7e-4797-8166-2f6db7189c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:05 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Volume volume-f27d0333-184d-4443-ae9e-70df9ad21cc2 (f27d0333-184d-4443-ae9e-70df9ad21cc2): created successfully Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ec19a0-df7e-4797-8166-2f6db7189c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Flow 'volume_create_manager' (bbc9463c-8955-4917-a382-7271d0dee509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:05 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-a136b392-af3b-46ae-9d19-db267213d0dc tempest-VolumesActionsTest-1123284758 None] Created volume successfully. Apr 13 17:27:06 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 1073741824" returned: 0 in 0.521s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:06 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 Apr 13 17:27:06 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Acquiring lock "cinder-f27d0333-184d-4443-ae9e-70df9ad21cc2-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Lock "cinder-f27d0333-184d-4443-ae9e-70df9ad21cc2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Acquiring lock "cinder-quobyte-f27d0333-184d-4443-ae9e-70df9ad21cc2" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Lock "cinder-quobyte-f27d0333-184d-4443-ae9e-70df9ad21cc2" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccca2b4-1fdf-4c70-b698-9c43e0df0537]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f27d0333-184d-4443-ae9e-70df9ad21cc2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:06 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f27d0333-184d-4443-ae9e-70df9ad21cc2 Apr 13 17:27:06 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:06 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795" returned: 0 in 0.516s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-211177013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fca12d-31fd-4a18-b06a-97f6e48ec677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0e16bf7e54aeba3924a8f82a1d5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:05Z,use_quota=True,user_id='4216ddff5d834da28163f3142f3e2325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Creating volume a0fca12d-31fd-4a18-b06a-97f6e48ec677 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:06 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b731d4e9-812c-45f4-8e07-fe42875db322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a40502-221e-4d9f-9983-7c18e4157795', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d33fba-c4fd-46c5-b1e0-a3bcba2ab90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:06 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 1073741824 Apr 13 17:27:06 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:06 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Volume volume-78a40502-221e-4d9f-9983-7c18e4157795 (78a40502-221e-4d9f-9983-7c18e4157795): created successfully Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d33fba-c4fd-46c5-b1e0-a3bcba2ab90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Flow 'volume_create_manager' (a747bee7-457b-4f44-b20e-c88c4439796e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:06 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-690f2348-2b9f-46dd-9a4c-c4b7657f22b2 tempest-VolumesCloneTest-1578376087 None] Created volume successfully. Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-85e20ad4-d657-4a2e-813d-bc9b96111a0c tempest-BackendsCapabilitiesAdminTestsJSON-1439288735 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81998) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 13 17:27:07 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f27d0333-184d-4443-ae9e-70df9ad21cc2" returned: 0 in 0.602s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f27d0333-184d-4443-ae9e-70df9ad21cc2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:07 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f27d0333-184d-4443-ae9e-70df9ad21cc2 Apr 13 17:27:07 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:07 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 1073741824" returned: 0 in 0.555s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:07 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 Apr 13 17:27:07 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-369a474d-a0b5-42b0-a36e-6eafc953242e tempest-BackendsCapabilitiesAdminTestsJSON-1439288735 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81998) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Flow 'volume_create_manager' (20e86e36-26a7-4425-ba89-db890e2d2fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f70e67-1ce0-4f5e-9640-7fef6820cab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f70e67-1ce0-4f5e-9640-7fef6820cab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1327371515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae030e64-0259-42dc-902a-08bab3e28135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5abc751a5e418c9fde74b4ccf22a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=78a40502-221e-4d9f-9983-7c18e4157795,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:08Z,use_quota=True,user_id='c8a6eeb90f4348d591e6e4d7963cef16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10b3b2f-340d-41e7-bac6-e0a77b3d731f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10b3b2f-340d-41e7-bac6-e0a77b3d731f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae377f1-7c83-4dd5-91df-c51d2b16b8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae377f1-7c83-4dd5-91df-c51d2b16b8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ae030e64-0259-42dc-902a-08bab3e28135', 'volume_name': 'volume-ae030e64-0259-42dc-902a-08bab3e28135', 'volume_size': 2, 'source_volid': '78a40502-221e-4d9f-9983-7c18e4157795', 'source_volstatus': 'available'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a4e7ff-bc09-4345-85c9-55f0cd87390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a4e7ff-bc09-4345-85c9-55f0cd87390a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3516e5-6ce4-454d-a7b9-3b423ec14df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:07 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Volume ae030e64-0259-42dc-902a-08bab3e28135: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ae030e64-0259-42dc-902a-08bab3e28135', 'volume_size': 2, 'source_volid': '78a40502-221e-4d9f-9983-7c18e4157795', 'source_volstatus': 'available'} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:07 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f27d0333-184d-4443-ae9e-70df9ad21cc2" returned: 0 in 0.524s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Lock "cinder-quobyte-f27d0333-184d-4443-ae9e-70df9ad21cc2" released by "delete_volume" :: held 1.148s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Created reservations ['b973a258-3930-4d10-a8c7-9342f2d69de2', '23b44a4b-ec8e-4554-8b03-171e1a6efc17', '036a392a-e996-4e3e-a9de-f358eaa3ab43', '2cbb6645-74b2-4b7c-812a-c7c77b8bbff4'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:07 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:07 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:08 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677" returned: 0 in 0.529s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.231s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:08 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Cloning volume 78a40502-221e-4d9f-9983-7c18e4157795 to volume ae030e64-0259-42dc-902a-08bab3e28135 Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af0977d-c4af-4a8a-b80b-2d68fccf99ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16275de-c4a9-4066-847b-fb390d860e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:08 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Volume volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 (a0fca12d-31fd-4a18-b06a-97f6e48ec677): created successfully Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16275de-c4a9-4066-847b-fb390d860e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Flow 'volume_create_manager' (8d9cb3da-2c76-490c-9e6c-f6387e57b4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Creating offline snapshot 1c925ff7-3200-4624-b507-5851d1e616f2 of volume 78a40502-221e-4d9f-9983-7c18e4157795 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:27:08 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-4f67ebfc-fa3c-4f9e-adb9-c8e05d6bfb2b tempest-VolumeDependencyTests-1494736895 None] Created volume successfully. Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ce77b2-28aa-466e-8f04-13a02e99906d]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:08 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 Apr 13 17:27:08 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:08 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.483s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:08 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Deleted volume successfully. Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ec196d4a-3196-474e-b760-effc16de3a1e tempest-VolumesActionsTest-688251563 None] Lock "cinder-f27d0333-184d-4443-ae9e-70df9ad21cc2-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:08 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795" returned: 0 in 0.636s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:08 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 1G Apr 13 17:27:08 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Flow 'volume_create_manager' (b698cbce-be90-4c58-b1c9-d67fd06f2627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41b149f-c87a-4d61-b77c-df3cac04e21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41b149f-c87a-4d61-b77c-df3cac04e21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-795819018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f691635-d778-419a-8af1-c1e666e0ab28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef48253aab9407c8133c4158e85d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:09Z,use_quota=True,user_id='9214eb1dfd8c4b85bfa34a039043c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d0b987-b0fa-46e3-a291-b1bcea7199eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d0b987-b0fa-46e3-a291-b1bcea7199eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a9b6ea-1a3e-4d64-b9a5-8d992c79bd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a9b6ea-1a3e-4d64-b9a5-8d992c79bd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f691635-d778-419a-8af1-c1e666e0ab28', 'volume_name': 'volume-4f691635-d778-419a-8af1-c1e666e0ab28', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70babad3-3e83-4f27-84d7-e1f59b68f8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70babad3-3e83-4f27-84d7-e1f59b68f8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f190422f-72ef-4111-b467-3c8307547b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:09 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Volume 4f691635-d778-419a-8af1-c1e666e0ab28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f691635-d778-419a-8af1-c1e666e0ab28', 'volume_size': 1} Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:09 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 1G" returned: 0 in 0.651s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a40502-221e-4d9f-9983-7c18e4157795 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:09 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a40502-221e-4d9f-9983-7c18e4157795 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 Apr 13 17:27:09 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:09 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a40502-221e-4d9f-9983-7c18e4157795 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2" returned: 0 in 0.531s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:09 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 is being set with open permissions: ugo+rw Apr 13 17:27:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:09 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 Apr 13 17:27:09 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:10 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2" returned: 0 in 0.534s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:10 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.info Apr 13 17:27:10 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:11 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.info" returned: 0 in 0.502s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:11 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.info is being set with open permissions: ugo+rw Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:11 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.info Apr 13 17:27:11 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:11 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.info" returned: 0 in 0.492s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Acquiring lock "cinder-quobyte-ae030e64-0259-42dc-902a-08bab3e28135" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Lock "cinder-quobyte-ae030e64-0259-42dc-902a-08bab3e28135" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] snapshot: 1c925ff7-3200-4624-b507-5851d1e616f2, volume: ae030e64-0259-42dc-902a-08bab3e28135, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae97459-e4c3-448f-8c20-751dba09b309]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:11 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 Apr 13 17:27:11 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:12 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2" returned: 0 in 0.540s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78a40502-221e-4d9f-9983-7c18e4157795(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:27:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:27:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:27:12 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a9d9e1-bd1c-4ad3-b621-1bacc1f41073]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:12 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 Apr 13 17:27:12 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:12 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795" returned: 0 in 0.580s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:12 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135 not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:27:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:12 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135 Apr 13 17:27:12 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:15 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135" returned: 0 in 2.418s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:15 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1859e1-f382-4b31-9e78-6b0010bbabc5]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:15 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 Apr 13 17:27:15 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:15 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795" returned: 0 in 0.695s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:15 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135 {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:27:15 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Converted 1024.00 MB image at 423.14 MB/s Apr 13 17:27:15 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135 is being set with open permissions: ugo+rw Apr 13 17:27:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:15 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135 Apr 13 17:27:15 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:16 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135" returned: 0 in 0.502s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Lock "cinder-quobyte-ae030e64-0259-42dc-902a-08bab3e28135" released by "_copy_volume_from_snapshot" :: held 4.790s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Acquiring lock "cinder-quobyte-1c925ff7-3200-4624-b507-5851d1e616f2" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Lock "cinder-quobyte-1c925ff7-3200-4624-b507-5851d1e616f2" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Deleting offline snapshot 1c925ff7-3200-4624-b507-5851d1e616f2 of volume 78a40502-221e-4d9f-9983-7c18e4157795 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:27:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] snapshot_file for this snap is: volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:27:16 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d86207-acee-4542-b42f-2b4013692bf1]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:16 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 Apr 13 17:27:16 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:16 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2" returned: 0 in 0.528s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78a40502-221e-4d9f-9983-7c18e4157795(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:27:16 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[235bccc8-6df8-4b20-85e1-be99e58caa9d]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:16 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 Apr 13 17:27:16 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:17 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795" returned: 0 in 0.632s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:17 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 Apr 13 17:27:17 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:18 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2" returned: 0 in 0.594s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:18 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2 Apr 13 17:27:18 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:18 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795.1c925ff7-3200-4624-b507-5851d1e616f2" returned: 0 in 0.481s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Lock "cinder-quobyte-1c925ff7-3200-4624-b507-5851d1e616f2" released by "_delete_snapshot" :: held 2.286s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.588s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.028s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] Creating offline snapshot b78a0bbb-e696-4056-a530-54a41ed79ac0 of volume a0fca12d-31fd-4a18-b06a-97f6e48ec677 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3516e5-6ce4-454d-a7b9-3b423ec14df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae030e64-0259-42dc-902a-08bab3e28135', 'volume_size': 2, 'source_volid': '78a40502-221e-4d9f-9983-7c18e4157795', 'source_volstatus': 'available'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9f5d70-f7be-495a-b5d9-176e4cc99cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[30484f6c-e990-48d7-9bf0-cfbf0db32d69]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:18 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Volume volume-ae030e64-0259-42dc-902a-08bab3e28135 (ae030e64-0259-42dc-902a-08bab3e28135): created successfully Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9f5d70-f7be-495a-b5d9-176e4cc99cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Flow 'volume_create_manager' (20e86e36-26a7-4425-ba89-db890e2d2fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:18 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d3838e2c-f8ec-4a83-a85f-43612197a962 tempest-VolumesCloneTest-1578376087 None] Created volume successfully. Apr 13 17:27:18 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 Apr 13 17:27:18 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:19 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677" returned: 0 in 0.542s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:19 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 1G Apr 13 17:27:19 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Acquiring lock "cinder-ae030e64-0259-42dc-902a-08bab3e28135-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Lock "cinder-ae030e64-0259-42dc-902a-08bab3e28135-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Acquiring lock "cinder-quobyte-ae030e64-0259-42dc-902a-08bab3e28135" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Lock "cinder-quobyte-ae030e64-0259-42dc-902a-08bab3e28135" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:19 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc0a923-a813-43b7-b28d-f76470703422]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:19 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135 Apr 13 17:27:19 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:19 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 1G" returned: 0 in 0.561s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:19 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 Apr 13 17:27:19 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:20 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135" returned: 0 in 0.598s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:20 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135 Apr 13 17:27:20 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:20 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0" returned: 0 in 0.532s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:20 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 is being set with open permissions: ugo+rw Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:20 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 Apr 13 17:27:20 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:20 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-ae030e64-0259-42dc-902a-08bab3e28135" returned: 0 in 0.456s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Lock "cinder-quobyte-ae030e64-0259-42dc-902a-08bab3e28135" released by "delete_volume" :: held 1.081s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Created reservations ['8ac35cb3-fd06-4e70-a53b-d325e427dc4d', '2d65b862-eec9-44b9-9d82-b810131e2566', '792a2297-ecd4-487c-8c36-4dc0e874e252', '48e53477-a096-4be9-81c4-5883f2246066'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:20 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:20 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:20 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0" returned: 0 in 0.503s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:20 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.info Apr 13 17:27:20 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:21 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.442s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:21 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Deleted volume successfully. Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01ac496b-c47c-4b9f-ba61-96698d60287c tempest-VolumesCloneTest-1578376087 None] Lock "cinder-ae030e64-0259-42dc-902a-08bab3e28135-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:21 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.info" returned: 0 in 0.512s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:21 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.info is being set with open permissions: ugo+rw Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:21 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.info Apr 13 17:27:21 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Acquiring lock "cinder-78a40502-221e-4d9f-9983-7c18e4157795-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Lock "cinder-78a40502-221e-4d9f-9983-7c18e4157795-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:21 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.info" returned: 0 in 0.473s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.211s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.513s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-795819018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f691635-d778-419a-8af1-c1e666e0ab28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef48253aab9407c8133c4158e85d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:09Z,use_quota=True,user_id='9214eb1dfd8c4b85bfa34a039043c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Creating volume 4f691635-d778-419a-8af1-c1e666e0ab28 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:21 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4f691635-d778-419a-8af1-c1e666e0ab28 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:21 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4f691635-d778-419a-8af1-c1e666e0ab28 1073741824 Apr 13 17:27:21 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Acquiring lock "cinder-quobyte-78a40502-221e-4d9f-9983-7c18e4157795" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:21 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-02607d8e-22e6-44f9-8446-f36bf9c6c357 tempest-VolumeDependencyTests-1494736895 None] Create snapshot completed successfully Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Lock "cinder-quobyte-78a40502-221e-4d9f-9983-7c18e4157795" acquired by "delete_volume" :: waited 0.024s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[384921ad-86ef-4b30-84e5-9cdd1b418be6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:22 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 Apr 13 17:27:22 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:22 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795" returned: 0 in 0.595s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:22 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795 Apr 13 17:27:22 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Flow 'volume_create_manager' (98bb0371-584a-4c73-8075-79162e01aaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:22 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9491547c-10da-4fef-8aa6-486880a6cc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4f691635-d778-419a-8af1-c1e666e0ab28 1073741824" returned: 0 in 0.760s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9491547c-10da-4fef-8aa6-486880a6cc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-172471335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7427f1b-b852-45b6-9d7b-a59b289cfa7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0e16bf7e54aeba3924a8f82a1d5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b78a0bbb-e696-4056-a530-54a41ed79ac0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:23Z,use_quota=True,user_id='4216ddff5d834da28163f3142f3e2325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2840ff-7272-4980-b446-4a8071234298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2840ff-7272-4980-b446-4a8071234298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1c6e43-ff36-43ae-91f9-1213691410c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1c6e43-ff36-43ae-91f9-1213691410c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7427f1b-b852-45b6-9d7b-a59b289cfa7c', 'volume_name': 'volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c', 'volume_size': 1, 'snapshot_id': 'b78a0bbb-e696-4056-a530-54a41ed79ac0'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169c92ad-f5ae-4802-a416-77f29282c791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169c92ad-f5ae-4802-a416-77f29282c791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58396e87-6843-4c4e-9a38-3f8089435034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:22 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Volume c7427f1b-b852-45b6-9d7b-a59b289cfa7c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c', 'volume_size': 1, 'snapshot_id': 'b78a0bbb-e696-4056-a530-54a41ed79ac0'} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4f691635-d778-419a-8af1-c1e666e0ab28 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:22 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4f691635-d778-419a-8af1-c1e666e0ab28 Apr 13 17:27:22 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:23 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-78a40502-221e-4d9f-9983-7c18e4157795" returned: 0 in 0.468s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Lock "cinder-quobyte-78a40502-221e-4d9f-9983-7c18e4157795" released by "delete_volume" :: held 1.105s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Created reservations ['9a71e072-4788-443a-92bb-d6d308b1ac4e', 'd2296abd-fc4e-4930-91fb-8b4de8964a4d', '35bc6574-4ec1-4e00-876b-a8a7a1d08702', 'f36d2c41-1475-4e0e-a04d-1d4c5140cb28'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:23 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:23 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:23 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4f691635-d778-419a-8af1-c1e666e0ab28" returned: 0 in 0.487s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.501s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-quobyte-b78a0bbb-e696-4056-a530-54a41ed79ac0-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" by "_create_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f190422f-72ef-4111-b467-3c8307547b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f691635-d778-419a-8af1-c1e666e0ab28', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64c5e34-ff68-4dc9-b454-2e932b770cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-b78a0bbb-e696-4056-a530-54a41ed79ac0-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Creating volume c7427f1b-b852-45b6-9d7b-a59b289cfa7c from snapshot b78a0bbb-e696-4056-a530-54a41ed79ac0 {{(pid=81998) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-quobyte-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:23 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Volume volume-4f691635-d778-419a-8af1-c1e666e0ab28 (4f691635-d778-419a-8af1-c1e666e0ab28): created successfully Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64c5e34-ff68-4dc9-b454-2e932b770cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Flow 'volume_create_manager' (b698cbce-be90-4c58-b1c9-d67fd06f2627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] snapshot: b78a0bbb-e696-4056-a530-54a41ed79ac0, volume: c7427f1b-b852-45b6-9d7b-a59b289cfa7c, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:23 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-7a40bc36-f37d-470a-8a56-0dc1fc8d5897 tempest-VolumesActionsTest-1123284758 None] Created volume successfully. Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b22830-a6fd-4161-9996-b3742b2498d6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:23 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 Apr 13 17:27:23 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:23 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.544s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:23 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Deleted volume successfully. Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92dce9e3-2c26-4f12-85d5-f36e6a980610 tempest-VolumesCloneTest-1578376087 None] Lock "cinder-78a40502-221e-4d9f-9983-7c18e4157795-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:23 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0" returned: 0 in 0.563s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a73b2f-7ada-4703-9d1c-be688b3b3ab7]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:23 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 Apr 13 17:27:23 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:24 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677" returned: 0 in 0.695s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:24 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:27:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:24 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c Apr 13 17:27:24 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "cinder-4f691635-d778-419a-8af1-c1e666e0ab28-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Lock "cinder-4f691635-d778-419a-8af1-c1e666e0ab28-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "cinder-quobyte-4f691635-d778-419a-8af1-c1e666e0ab28" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Lock "cinder-quobyte-4f691635-d778-419a-8af1-c1e666e0ab28" acquired by "delete_volume" :: waited 0.019s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:24 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dffff4f-5a5e-4ebf-9a81-e1ab047052c4]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4f691635-d778-419a-8af1-c1e666e0ab28 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:25 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4f691635-d778-419a-8af1-c1e666e0ab28 Apr 13 17:27:25 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:27 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4f691635-d778-419a-8af1-c1e666e0ab28" returned: 0 in 2.173s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4f691635-d778-419a-8af1-c1e666e0ab28 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:27 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4f691635-d778-419a-8af1-c1e666e0ab28 Apr 13 17:27:27 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:27 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" returned: 0 in 2.561s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f410a1f-cf66-4843-944a-86597828d93b]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:27 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 Apr 13 17:27:27 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:27 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-4f691635-d778-419a-8af1-c1e666e0ab28" returned: 0 in 0.449s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Lock "cinder-quobyte-4f691635-d778-419a-8af1-c1e666e0ab28" released by "delete_volume" :: held 2.653s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Created reservations ['a891e24d-39dc-4626-a78d-22fdaa7fd5af', '55b7571c-e713-46b1-9999-f2ac9cb74c57', 'cb3c1a5b-0011-4e7d-bde8-943dfc17a7f6', '11676e87-5c9c-4235-aae8-1f50bb280931'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:27 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:27 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:27 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677" returned: 0 in 0.765s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677, size 1024.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:27:27 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Converted 1024.00 MB image at 399.67 MB/s Apr 13 17:27:27 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c is being set with open permissions: ugo+rw Apr 13 17:27:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:27 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c Apr 13 17:27:27 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:28 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.529s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:28 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Deleted volume successfully. Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f00cab76-5f8a-46ae-9d1e-de035ecb7c37 tempest-VolumesActionsTest-1123284758 None] Lock "cinder-4f691635-d778-419a-8af1-c1e666e0ab28-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:28 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Flow 'volume_create_manager' (da948b3a-0670-44f1-9b55-e3ce1e374dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473fcd8b-df57-4743-861c-204eeb86df8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" returned: 0 in 0.594s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473fcd8b-df57-4743-861c-204eeb86df8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-917745151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2de5f39-64f1-415f-9df7-6677f58dff83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bb415cf7b0429daff89b1315746d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:28Z,use_quota=True,user_id='d56c09c3794c4123898c4f3ab8dca59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af3c23f-08f2-4f94-8296-d05da097eed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af3c23f-08f2-4f94-8296-d05da097eed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3910e57f-aed7-4a29-81c5-f32c0c8adf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3910e57f-aed7-4a29-81c5-f32c0c8adf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2de5f39-64f1-415f-9df7-6677f58dff83', 'volume_name': 'volume-d2de5f39-64f1-415f-9df7-6677f58dff83', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc39d5ed-299a-4123-bc73-a3f9f764e2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc39d5ed-299a-4123-bc73-a3f9f764e2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d80fe3b-71fa-4be0-ad57-34e824e6fb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:28 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Volume d2de5f39-64f1-415f-9df7-6677f58dff83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2de5f39-64f1-415f-9df7-6677f58dff83', 'volume_size': 1} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" released by "_copy_volume_from_snapshot" :: held 5.293s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-b78a0bbb-e696-4056-a530-54a41ed79ac0-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" released by "_create_volume_from_snapshot" :: held 5.322s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.359s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-917745151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2de5f39-64f1-415f-9df7-6677f58dff83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bb415cf7b0429daff89b1315746d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:28Z,use_quota=True,user_id='d56c09c3794c4123898c4f3ab8dca59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Creating volume d2de5f39-64f1-415f-9df7-6677f58dff83 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:28 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d2de5f39-64f1-415f-9df7-6677f58dff83 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:28 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d2de5f39-64f1-415f-9df7-6677f58dff83 1073741824 Apr 13 17:27:28 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Flow 'volume_create_manager' (31365994-f67e-4d89-8a9c-05258ca6dfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dabfea8-d816-432b-a2b0-42b03f01f046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58396e87-6843-4c4e-9a38-3f8089435034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c', 'volume_size': 1, 'snapshot_id': 'b78a0bbb-e696-4056-a530-54a41ed79ac0'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05bbbbc5-52a5-409f-94d9-45fc4252a628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dabfea8-d816-432b-a2b0-42b03f01f046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1726074289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b0f354-9c79-4ef6-a276-785f4f103aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881bf1b4775f4558a3161bf0d063f973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:29Z,use_quota=True,user_id='ba148f033be44db791d135e83ae29e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab441322-aafe-4ced-ae38-f77450cb050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab441322-aafe-4ced-ae38-f77450cb050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f33105b-537e-4f3a-9466-d35e8855f812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.image.glance [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Creating Keystone auth plugin from conf {{(pid=81998) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 17:27:28 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Volume volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c (c7427f1b-b852-45b6-9d7b-a59b289cfa7c): created successfully Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05bbbbc5-52a5-409f-94d9-45fc4252a628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Flow 'volume_create_manager' (98bb0371-584a-4c73-8075-79162e01aaab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:28 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-5e15f035-315c-4e20-80ee-399b4c06d343 tempest-VolumeDependencyTests-1494736895 None] Created volume successfully. Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f33105b-537e-4f3a-9466-d35e8855f812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8b0f354-9c79-4ef6-a276-785f4f103aaf', 'volume_name': 'volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf', 'volume_size': 1, 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afd653b3e1644792a661ae2b4015619a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'created_at': datetime.datetime(2026, 4, 13, 15, 17, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/696022cb-dcc0-451a-9908-378fc3a9d5ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9638e5-f134-468f-ab2e-a017969338cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9638e5-f134-468f-ab2e-a017969338cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cc10fc-5845-477c-b0e6-43835610a6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:28 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Volume b8b0f354-9c79-4ef6-a276-785f4f103aaf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf', 'volume_size': 1, 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afd653b3e1644792a661ae2b4015619a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'created_at': datetime.datetime(2026, 4, 13, 15, 17, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/696022cb-dcc0-451a-9908-378fc3a9d5ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Trying to clone b8b0f354-9c79-4ef6-a276-785f4f103aaf from image 696022cb-dcc0-451a-9908-378fc3a9d5ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]). {{(pid=81998) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 17:27:28 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81998) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 17:27:28 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Image download 20.69 MB at 20.69 MB/s Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1d5ecf-84c0-44ab-afee-d42764fbd9e4]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:29 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD Apr 13 17:27:29 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:29 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d2de5f39-64f1-415f-9df7-6677f58dff83 1073741824" returned: 0 in 0.615s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d2de5f39-64f1-415f-9df7-6677f58dff83 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:29 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d2de5f39-64f1-415f-9df7-6677f58dff83 Apr 13 17:27:29 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-b78a0bbb-e696-4056-a530-54a41ed79ac0-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:29 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-b78a0bbb-e696-4056-a530-54a41ed79ac0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-quobyte-a0fca12d-31fd-4a18-b06a-97f6e48ec677" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD" returned: 0 in 0.616s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Temporary image 696022cb-dcc0-451a-9908-378fc3a9d5ca is fetched for user ba148f033be44db791d135e83ae29e10. {{(pid=81998) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-a0fca12d-31fd-4a18-b06a-97f6e48ec677" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-quobyte-b78a0bbb-e696-4056-a530-54a41ed79ac0" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-b78a0bbb-e696-4056-a530-54a41ed79ac0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Deleting offline snapshot b78a0bbb-e696-4056-a530-54a41ed79ac0 of volume a0fca12d-31fd-4a18-b06a-97f6e48ec677 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] snapshot_file for this snap is: volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69e3858-c8ea-46a6-a0da-569ff3de5f54]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a0493b-fc7e-4f15-80fb-2e24892cb39f]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:29 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d2de5f39-64f1-415f-9df7-6677f58dff83" returned: 0 in 0.562s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d80fe3b-71fa-4be0-ad57-34e824e6fb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2de5f39-64f1-415f-9df7-6677f58dff83', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:29 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 Apr 13 17:27:29 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8785a8e-1570-4e46-9eec-e0edf8966f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:29 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Volume volume-d2de5f39-64f1-415f-9df7-6677f58dff83 (d2de5f39-64f1-415f-9df7-6677f58dff83): created successfully Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8785a8e-1570-4e46-9eec-e0edf8966f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Flow 'volume_create_manager' (da948b3a-0670-44f1-9b55-e3ce1e374dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:29 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-1be050b3-9789-4e0b-9db5-3a85ccd90852 tempest-VolumesTransfersV355Test-187975849 None] Created volume successfully. Apr 13 17:27:29 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD Apr 13 17:27:29 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:30 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0" returned: 0 in 0.512s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[17404e2f-34ef-4a1f-a081-112c08c3bcd9]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:30 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1726074289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b0f354-9c79-4ef6-a276-785f4f103aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881bf1b4775f4558a3161bf0d063f973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:29Z,use_quota=True,user_id='ba148f033be44db791d135e83ae29e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Creating volume b8b0f354-9c79-4ef6-a276-785f4f103aaf {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:30 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:30 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf 1073741824 Apr 13 17:27:30 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:30 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 Apr 13 17:27:30 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:30 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677" returned: 0 in 0.649s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:30 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 Apr 13 17:27:30 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:30 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf 1073741824" returned: 0 in 0.677s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:31 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf Apr 13 17:27:31 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:31 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-37743e25-4ac9-4015-a4a6-4d090b64263d tempest-VolumesTransfersV355Test-1161131486 None] Transfer volume completed successfully. Apr 13 17:27:31 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf" returned: 0 in 0.453s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:31 devstack cinder-volume[81998]: DEBUG cinder.volume.volume_utils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Attempting download of 696022cb-dcc0-451a-9908-378fc3a9d5ca ((None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}])) to volume b8b0f354-9c79-4ef6-a276-785f4f103aaf. {{(pid=81998) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 17:27:31 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bd2de3-748e-455f-a9de-6d48b5f994b3]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_ojgl72ta {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:31 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0" returned: 0 in 0.639s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:31 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0 Apr 13 17:27:31 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:31 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_ojgl72ta Apr 13 17:27:31 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:32 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_ojgl72ta" returned: 0 in 0.541s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_ojgl72ta {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:32 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677.b78a0bbb-e696-4056-a530-54a41ed79ac0" returned: 0 in 0.519s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-b78a0bbb-e696-4056-a530-54a41ed79ac0" released by "_delete_snapshot" :: held 2.433s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-a0fca12d-31fd-4a18-b06a-97f6e48ec677" released by "delete_snapshot" :: held 2.452s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:32 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_ojgl72ta Apr 13 17:27:32 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Created reservations ['340ad1fc-30a5-4bb7-8fcf-d842578a710b', 'a545336e-a4a4-49ca-b190-6874ff5e378b', '4a0615cc-2004-4c0a-8728-07f555ec537a', 'd3c0dde0-4bec-4616-b07e-901b06921175'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Acquiring lock "cinder-d2de5f39-64f1-415f-9df7-6677f58dff83-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Lock "cinder-d2de5f39-64f1-415f-9df7-6677f58dff83-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Acquiring lock "cinder-quobyte-d2de5f39-64f1-415f-9df7-6677f58dff83" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:32 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Delete snapshot completed successfully. Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e8c3d92d-795a-4a75-8b57-1a682e74f9ee tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-b78a0bbb-e696-4056-a530-54a41ed79ac0-delete_snapshot" released by "delete_snapshot" :: held 2.719s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Lock "cinder-quobyte-d2de5f39-64f1-415f-9df7-6677f58dff83" acquired by "delete_volume" :: waited 0.023s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a4a4ef-a9f4-4555-95bb-db6594826a89]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d2de5f39-64f1-415f-9df7-6677f58dff83 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:32 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d2de5f39-64f1-415f-9df7-6677f58dff83 Apr 13 17:27:32 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:32 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_ojgl72ta" returned: 1 in 0.559s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_ojgl72ta' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fb8d43-81d6-4f98-9daa-56d3b37f5b91]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:32 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD Apr 13 17:27:32 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-a0fca12d-31fd-4a18-b06a-97f6e48ec677-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-a0fca12d-31fd-4a18-b06a-97f6e48ec677-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-quobyte-a0fca12d-31fd-4a18-b06a-97f6e48ec677" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-a0fca12d-31fd-4a18-b06a-97f6e48ec677" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c120e320-ad46-481d-920c-817f95236521]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:32 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d2de5f39-64f1-415f-9df7-6677f58dff83" returned: 0 in 0.594s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d2de5f39-64f1-415f-9df7-6677f58dff83 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:33 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d2de5f39-64f1-415f-9df7-6677f58dff83 Apr 13 17:27:33 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:33 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 Apr 13 17:27:33 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:33 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD" returned: 0 in 0.610s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] 696022cb-dcc0-451a-9908-378fc3a9d5ca was qcow2, converting to raw {{(pid=81998) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:33 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf Apr 13 17:27:33 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:33 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d2de5f39-64f1-415f-9df7-6677f58dff83" returned: 0 in 0.498s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Lock "cinder-quobyte-d2de5f39-64f1-415f-9df7-6677f58dff83" released by "delete_volume" :: held 1.128s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Created reservations ['7fe6f933-e278-464c-8300-80c11e7e5f75', '5d41bc2b-6aa1-4570-b55c-424c9a266877', '3a35cc78-1d7a-4bcb-884b-692a82748151', 'dd414f29-af9d-4702-a4a9-6e07e9196ca6'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:33 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_service.periodic_task [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:33 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:33 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677" returned: 0 in 0.664s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:33 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677 Apr 13 17:27:33 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:33 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:33 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:34 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.681s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:34 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Deleted volume successfully. Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-29547fee-1263-45c9-83c8-0e179027bdd4 tempest-VolumesTransfersV355Test-212320355 None] Lock "cinder-d2de5f39-64f1-415f-9df7-6677f58dff83-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:34 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a0fca12d-31fd-4a18-b06a-97f6e48ec677" returned: 0 in 0.706s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-a0fca12d-31fd-4a18-b06a-97f6e48ec677" released by "delete_volume" :: held 1.411s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:34 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.764s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Created reservations ['3ee56f75-83e8-4d85-9152-016ae55af9dc', 'e8cdc59b-c163-4179-91c4-04751bae1270', '934d0d94-3038-4ab2-bb3b-be9bdb328d0d', '4c9e9adb-0f54-448b-8a43-46572d5a7ed6'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:34 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:34 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:34 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf" returned: 0 in 1.318s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_72_lv6vwdevstack@QuobyteHD, size 112.00 MB, duration 1.32 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:27:34 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Converted 112.00 MB image at 84.88 MB/s Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:34 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf 1G Apr 13 17:27:34 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Flow 'volume_create_manager' (30a805f2-83dd-4cfd-b9c7-ec2bda0b1f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa4db41-1dc9-4072-89d7-2c8bf0791719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa4db41-1dc9-4072-89d7-2c8bf0791719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1173491523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963c313e-d876-4db1-9f01-6c453f538cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bb415cf7b0429daff89b1315746d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:35Z,use_quota=True,user_id='d56c09c3794c4123898c4f3ab8dca59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960ea3d9-f81e-4ecd-8178-72dc3e9a1875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960ea3d9-f81e-4ecd-8178-72dc3e9a1875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d998b11-fcf2-4d2f-947f-790d429c4b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d998b11-fcf2-4d2f-947f-790d429c4b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '963c313e-d876-4db1-9f01-6c453f538cff', 'volume_name': 'volume-963c313e-d876-4db1-9f01-6c453f538cff', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d760f2-1fcf-48ab-a7aa-5b1c4a6949e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d760f2-1fcf-48ab-a7aa-5b1c4a6949e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c090c8-b6ea-40b0-8862-84dacc703bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:34 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Volume 963c313e-d876-4db1-9f01-6c453f538cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-963c313e-d876-4db1-9f01-6c453f538cff', 'volume_size': 1} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1173491523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963c313e-d876-4db1-9f01-6c453f538cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bb415cf7b0429daff89b1315746d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:35Z,use_quota=True,user_id='d56c09c3794c4123898c4f3ab8dca59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Creating volume 963c313e-d876-4db1-9f01-6c453f538cff {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:34 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:27:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-963c313e-d876-4db1-9f01-6c453f538cff 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:35 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-963c313e-d876-4db1-9f01-6c453f538cff 1073741824 Apr 13 17:27:35 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:35 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.672s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:35 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Deleted volume successfully. Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-88584a34-9546-4433-989c-8ef6c25723cf tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-a0fca12d-31fd-4a18-b06a-97f6e48ec677-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:35 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf 1G" returned: 0 in 0.623s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6e19b3-328e-454d-af63-bcf306dc8a8b]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:35 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf Apr 13 17:27:35 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Flow 'volume_create_manager' (4e848dbe-80a3-4dfb-9d8a-9b45f4754ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d50afa-64b8-48a0-9686-9acc1651b23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d50afa-64b8-48a0-9686-9acc1651b23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1177194186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0e16bf7e54aeba3924a8f82a1d5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:35Z,use_quota=True,user_id='4216ddff5d834da28163f3142f3e2325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f257db-89a1-4418-8058-d57ffd82f068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f257db-89a1-4418-8058-d57ffd82f068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3be630b-9c22-459f-861e-af99e18ddd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3be630b-9c22-459f-861e-af99e18ddd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c', 'volume_name': 'volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74465569-53ef-4ecf-adc6-9c0fadc2a212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74465569-53ef-4ecf-adc6-9c0fadc2a212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39265d97-1043-43a7-8d72-9e4d8b33a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:35 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Volume fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c', 'volume_size': 1} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:35 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-963c313e-d876-4db1-9f01-6c453f538cff 1073741824" returned: 0 in 0.681s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-963c313e-d876-4db1-9f01-6c453f538cff {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:35 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-963c313e-d876-4db1-9f01-6c453f538cff Apr 13 17:27:35 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:35 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf" returned: 0 in 0.686s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:35 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf Apr 13 17:27:35 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:36 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-963c313e-d876-4db1-9f01-6c453f538cff" returned: 0 in 0.490s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.584s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1177194186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0e16bf7e54aeba3924a8f82a1d5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:35Z,use_quota=True,user_id='4216ddff5d834da28163f3142f3e2325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Creating volume fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:36 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c090c8-b6ea-40b0-8862-84dacc703bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-963c313e-d876-4db1-9f01-6c453f538cff', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:36 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c 1073741824 Apr 13 17:27:36 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757d436d-b546-4edf-aa68-66349baf0bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:36 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Volume volume-963c313e-d876-4db1-9f01-6c453f538cff (963c313e-d876-4db1-9f01-6c453f538cff): created successfully Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757d436d-b546-4edf-aa68-66349baf0bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Flow 'volume_create_manager' (30a805f2-83dd-4cfd-b9c7-ec2bda0b1f44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:36 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-61f4a081-972c-419d-9d31-59c468dae72c tempest-VolumesTransfersV355Test-187975849 None] Created volume successfully. Apr 13 17:27:36 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf" returned: 1 in 0.595s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.volume_utils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Downloaded image 696022cb-dcc0-451a-9908-378fc3a9d5ca ((None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}])) to volume b8b0f354-9c79-4ef6-a276-785f4f103aaf successfully. {{(pid=81998) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Temporary image 696022cb-dcc0-451a-9908-378fc3a9d5ca for user ba148f033be44db791d135e83ae29e10 is deleted. {{(pid=81998) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.volume_utils [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Marking volume b8b0f354-9c79-4ef6-a276-785f4f103aaf as bootable. {{(pid=81998) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Copying metadata from image 696022cb-dcc0-451a-9908-378fc3a9d5ca to b8b0f354-9c79-4ef6-a276-785f4f103aaf. {{(pid=81998) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Creating volume glance metadata for volume b8b0f354-9c79-4ef6-a276-785f4f103aaf backed by image 696022cb-dcc0-451a-9908-378fc3a9d5ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81998) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cc10fc-5845-477c-b0e6-43835610a6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf', 'volume_size': 1, 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afd653b3e1644792a661ae2b4015619a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'created_at': datetime.datetime(2026, 4, 13, 15, 17, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/696022cb-dcc0-451a-9908-378fc3a9d5ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8634e8dd-997e-4dcc-a019-a3383476ec2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:36 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Volume volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf (b8b0f354-9c79-4ef6-a276-785f4f103aaf): created successfully Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8634e8dd-997e-4dcc-a019-a3383476ec2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Flow 'volume_create_manager' (31365994-f67e-4d89-8a9c-05258ca6dfeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:36 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-2f0627d9-ffd4-4924-86d8-4e70c91c9066 tempest-VolumesExtendTest-1815092270 None] Created volume successfully. Apr 13 17:27:36 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c 1073741824" returned: 0 in 0.658s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:36 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c Apr 13 17:27:36 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Acquiring lock "cinder-963c313e-d876-4db1-9f01-6c453f538cff-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Lock "cinder-963c313e-d876-4db1-9f01-6c453f538cff-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Acquiring lock "cinder-quobyte-963c313e-d876-4db1-9f01-6c453f538cff" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Lock "cinder-quobyte-963c313e-d876-4db1-9f01-6c453f538cff" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:37 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c" returned: 0 in 0.510s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a73dee-cb84-4736-b710-f1a098f7311f]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-963c313e-d876-4db1-9f01-6c453f538cff {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39265d97-1043-43a7-8d72-9e4d8b33a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278decb6-7b21-4de1-b63a-75260df3c789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:37 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Volume volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c (fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c): created successfully Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278decb6-7b21-4de1-b63a-75260df3c789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Flow 'volume_create_manager' (4e848dbe-80a3-4dfb-9d8a-9b45f4754ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:37 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-2d2f132f-3e7a-4d7f-96a5-97f1b85684f4 tempest-VolumeDependencyTests-1494736895 None] Created volume successfully. Apr 13 17:27:37 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-963c313e-d876-4db1-9f01-6c453f538cff Apr 13 17:27:37 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-15faeacd-0163-4fc1-b4c2-7a4f91e1c0fe tempest-VolumesExtendTest-1815092270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-15faeacd-0163-4fc1-b4c2-7a4f91e1c0fe tempest-VolumesExtendTest-1815092270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5323d1e6-389c-468f-911b-51b666ed44b6]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15faeacd-0163-4fc1-b4c2-7a4f91e1c0fe tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Flow 'volume_create_manager' (d6c262ae-3432-41ef-9b04-8430864ef2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c4b22c-5181-417d-b38d-67eb647e2023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c4b22c-5181-417d-b38d-67eb647e2023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1759347536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa0329e-4da2-40b4-94c5-8c7f3234d86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5dc09d089474ef1afc7b1e969435739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:38Z,use_quota=True,user_id='054b756dd7db4c4792ff2f161ad664ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40e290c-3c0e-49ff-a681-fe66751692ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40e290c-3c0e-49ff-a681-fe66751692ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790bfc88-75ad-40af-985d-c6759b437fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.image.glance [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Creating Keystone auth plugin from conf {{(pid=81998) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 17:27:37 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf Apr 13 17:27:37 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790bfc88-75ad-40af-985d-c6759b437fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'efa0329e-4da2-40b4-94c5-8c7f3234d86d', 'volume_name': 'volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d', 'volume_size': 1, 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afd653b3e1644792a661ae2b4015619a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'created_at': datetime.datetime(2026, 4, 13, 15, 17, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/696022cb-dcc0-451a-9908-378fc3a9d5ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76183c3b-af03-4643-97f4-9870bb8b7c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76183c3b-af03-4643-97f4-9870bb8b7c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c69b941-8cbe-4f25-a54e-f02c8e4e93ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:37 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Volume efa0329e-4da2-40b4-94c5-8c7f3234d86d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d', 'volume_size': 1, 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afd653b3e1644792a661ae2b4015619a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'created_at': datetime.datetime(2026, 4, 13, 15, 17, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/696022cb-dcc0-451a-9908-378fc3a9d5ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 17:27:37 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Trying to clone efa0329e-4da2-40b4-94c5-8c7f3234d86d from image 696022cb-dcc0-451a-9908-378fc3a9d5ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]). {{(pid=81998) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Flow 'volume_create_manager' (c5746f52-a82a-4e64-b7dc-22f893210007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:38 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bf0a57-0cc9-491a-b321-d02df0cdd899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bf0a57-0cc9-491a-b321-d02df0cdd899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1413564469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0e16bf7e54aeba3924a8f82a1d5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:38Z,use_quota=True,user_id='4216ddff5d834da28163f3142f3e2325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6a25ae-5c17-4edf-ba33-d0e7b79a5fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6a25ae-5c17-4edf-ba33-d0e7b79a5fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604a1b8e-2dae-4576-8693-e562d1b478b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-963c313e-d876-4db1-9f01-6c453f538cff" returned: 0 in 0.704s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81998) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 17:27:38 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Image download 20.69 MB at 20.69 MB/s Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-963c313e-d876-4db1-9f01-6c453f538cff {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604a1b8e-2dae-4576-8693-e562d1b478b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3', 'volume_name': 'volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3', 'volume_size': 1, 'source_volid': 'fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c', 'source_volstatus': 'available'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8bc893-1cc5-4113-b7ca-257d4120b71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8bc893-1cc5-4113-b7ca-257d4120b71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40caaaa-95cc-4cba-ba66-84e20912c332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:38 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Volume 41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3', 'volume_size': 1, 'source_volid': 'fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c', 'source_volstatus': 'available'} Apr 13 17:27:38 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-963c313e-d876-4db1-9f01-6c453f538cff Apr 13 17:27:38 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9f8ce5-2b13-4868-a839-7f274bf4f789]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:38 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15faeacd-0163-4fc1-b4c2-7a4f91e1c0fe tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf" returned: 0 in 0.605s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15faeacd-0163-4fc1-b4c2-7a4f91e1c0fe tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:38 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD Apr 13 17:27:38 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:38 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf Apr 13 17:27:38 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:38 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-963c313e-d876-4db1-9f01-6c453f538cff" returned: 0 in 0.498s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Lock "cinder-quobyte-963c313e-d876-4db1-9f01-6c453f538cff" released by "delete_volume" :: held 1.243s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Created reservations ['ebb85b79-a0b4-4acc-99be-891b92bd8ca1', 'ae2dcb09-7e89-4ec2-b026-78a788674601', 'f13a3720-48c2-4faf-80e7-8d556c2e869b', '57e644cf-cda6-4844-9af6-f284caa8b98b'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:38 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD" returned: 0 in 0.514s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Temporary image 696022cb-dcc0-451a-9908-378fc3a9d5ca is fetched for user 054b756dd7db4c4792ff2f161ad664ce. {{(pid=81998) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 17:27:38 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15faeacd-0163-4fc1-b4c2-7a4f91e1c0fe tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf" returned: 1 in 0.517s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15faeacd-0163-4fc1-b4c2-7a4f91e1c0fe tempest-VolumesExtendTest-1815092270 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15faeacd-0163-4fc1-b4c2-7a4f91e1c0fe tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf 2G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:38 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:38 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15faeacd-0163-4fc1-b4c2-7a4f91e1c0fe tempest-VolumesExtendTest-1815092270 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf 2G" returned: 0 in 0.052s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-15faeacd-0163-4fc1-b4c2-7a4f91e1c0fe tempest-VolumesExtendTest-1815092270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.232s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.612s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:38 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Cloning volume fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c to volume 41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[007d604a-6c5c-46b7-84e9-e7d9a41d9dbb]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:38 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-15faeacd-0163-4fc1-b4c2-7a4f91e1c0fe tempest-VolumesExtendTest-1815092270 None] Extend volume completed successfully. Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Creating offline snapshot 59d98802-1f79-40fe-9e49-f69fbed7a998 of volume fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[015080c5-0600-489a-af25-e3a6abead4b6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:38 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD Apr 13 17:27:38 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:38 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c Apr 13 17:27:38 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:39 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.408s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:39 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Deleted volume successfully. Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-07dce803-a252-4907-8039-211966055c63 tempest-VolumesTransfersV355Test-212320355 None] Lock "cinder-963c313e-d876-4db1-9f01-6c453f538cff-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:39 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD" returned: 0 in 0.499s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:39 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c" returned: 0 in 0.484s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:39 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 1G Apr 13 17:27:39 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Acquiring lock "cinder-b8b0f354-9c79-4ef6-a276-785f4f103aaf-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Lock "cinder-b8b0f354-9c79-4ef6-a276-785f4f103aaf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:39 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Acquiring lock "cinder-quobyte-b8b0f354-9c79-4ef6-a276-785f4f103aaf" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 1G" returned: 0 in 0.600s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Lock "cinder-quobyte-b8b0f354-9c79-4ef6-a276-785f4f103aaf" acquired by "delete_volume" :: waited 0.022s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:39 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 Apr 13 17:27:39 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ece8f2d-0e1c-4610-92bf-bb57ed086f06]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:40 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf Apr 13 17:27:40 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:40 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998" returned: 0 in 0.508s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:40 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 is being set with open permissions: ugo+rw Apr 13 17:27:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:40 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 Apr 13 17:27:40 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:40 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf" returned: 0 in 0.606s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:40 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf Apr 13 17:27:40 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:40 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998" returned: 0 in 0.491s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:40 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.info Apr 13 17:27:40 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:41 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf" returned: 1 in 0.637s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:41 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf Apr 13 17:27:41 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:41 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.info" returned: 0 in 0.495s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:41 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.info is being set with open permissions: ugo+rw Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:41 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.info Apr 13 17:27:41 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:41 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-b8b0f354-9c79-4ef6-a276-785f4f103aaf" returned: 0 in 0.461s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Lock "cinder-quobyte-b8b0f354-9c79-4ef6-a276-785f4f103aaf" released by "delete_volume" :: held 1.755s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Created reservations ['b982e54b-d4b5-4b9e-b1f3-4073acdced1d', 'fad519b9-0aed-4087-ad2c-836122b40f14', 'd6e30358-9b69-4f53-bcee-8963e7c8beb5', '011c84b4-93f9-4237-9916-327de9968556'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:41 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:41 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:41 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.info" returned: 0 in 0.501s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-quobyte-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] snapshot: 59d98802-1f79-40fe-9e49-f69fbed7a998, volume: 41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8e0ba8-a726-44b7-9e55-78a145eb94ea]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:42 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 Apr 13 17:27:42 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Flow 'volume_create_manager' (496da196-780b-4990-908d-8e9c74c17d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c961d7-09c0-4e04-a765-f9aad9093b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c961d7-09c0-4e04-a765-f9aad9093b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1402286640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61a28f6-ffa2-4226-aa31-a445dd01333e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881bf1b4775f4558a3161bf0d063f973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:42Z,use_quota=True,user_id='ba148f033be44db791d135e83ae29e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1794098-4d89-4964-9bf6-da906cb16da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1794098-4d89-4964-9bf6-da906cb16da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d0671a-7b34-4ece-a11a-d405983db9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d0671a-7b34-4ece-a11a-d405983db9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a61a28f6-ffa2-4226-aa31-a445dd01333e', 'volume_name': 'volume-a61a28f6-ffa2-4226-aa31-a445dd01333e', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7230941b-69a7-46eb-9447-b41ad5807978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7230941b-69a7-46eb-9447-b41ad5807978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6567ccd3-cf1c-4212-b1f2-cec45cc1bb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:42 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Volume a61a28f6-ffa2-4226-aa31-a445dd01333e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a61a28f6-ffa2-4226-aa31-a445dd01333e', 'volume_size': 1} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:42 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.567s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:42 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Deleted volume successfully. Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1ac7cfee-8966-4896-be58-fb525594958c tempest-VolumesExtendTest-1815092270 None] Lock "cinder-b8b0f354-9c79-4ef6-a276-785f4f103aaf-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:42 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998" returned: 0 in 0.669s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb23cc5-bb98-4caf-8b24-ff37e40c5279]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:42 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c Apr 13 17:27:42 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:43 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c" returned: 0 in 0.563s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:43 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:27:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:43 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 Apr 13 17:27:43 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:45 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3" returned: 0 in 2.389s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:45 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caf4c36-e678-4d83-b63b-cd8482606226]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:45 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c Apr 13 17:27:45 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:46 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c" returned: 0 in 0.681s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c, size 1024.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:27:46 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Converted 1024.00 MB image at 428.29 MB/s Apr 13 17:27:46 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 is being set with open permissions: ugo+rw Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:46 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 Apr 13 17:27:46 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Flow 'volume_create_manager' (968baeaf-1ab1-4636-a545-d7c572a36bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98306091-3fd6-460d-a115-81459cb7c46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98306091-3fd6-460d-a115-81459cb7c46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-660848129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1c10ee-af3a-4e63-a7f3-d488cc673133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b7d8e53c01492991160c6eb5e377a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:46Z,use_quota=True,user_id='24a1658bcb8b4326ab3d9babf3f4078f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe842c4-9f0e-4fae-93eb-5f7ad7ae6ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe842c4-9f0e-4fae-93eb-5f7ad7ae6ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d611483b-13b6-4e4f-9894-56250978165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d611483b-13b6-4e4f-9894-56250978165f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1c10ee-af3a-4e63-a7f3-d488cc673133', 'volume_name': 'volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d501c78-4003-469d-913b-3b3828634f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d501c78-4003-469d-913b-3b3828634f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3e6456-a3f2-48e7-9234-ff70baf15a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:46 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Volume 9d1c10ee-af3a-4e63-a7f3-d488cc673133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133', 'volume_size': 1} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:46 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3" returned: 0 in 0.470s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3" released by "_copy_volume_from_snapshot" :: held 4.833s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-quobyte-59d98802-1f79-40fe-9e49-f69fbed7a998" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-59d98802-1f79-40fe-9e49-f69fbed7a998" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Deleting offline snapshot 59d98802-1f79-40fe-9e49-f69fbed7a998 of volume fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] snapshot_file for this snap is: volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[14241714-e9bf-40b2-88c1-a38a6680dda4]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:46 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 Apr 13 17:27:46 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:47 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998" returned: 0 in 0.511s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:47 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:27:47 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6191e329-ffc5-47bf-a533-da507c7355fa]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:47 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c Apr 13 17:27:47 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:47 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c" returned: 0 in 0.512s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:47 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 Apr 13 17:27:47 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:48 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998" returned: 0 in 0.471s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:48 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998 Apr 13 17:27:48 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:48 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c.59d98802-1f79-40fe-9e49-f69fbed7a998" returned: 0 in 0.418s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-59d98802-1f79-40fe-9e49-f69fbed7a998" released by "_delete_snapshot" :: held 1.964s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.053s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.539s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1759347536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa0329e-4da2-40b4-94c5-8c7f3234d86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5dc09d089474ef1afc7b1e969435739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:38Z,use_quota=True,user_id='054b756dd7db4c4792ff2f161ad664ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Creating volume efa0329e-4da2-40b4-94c5-8c7f3234d86d {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:48 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40caaaa-95cc-4cba-ba66-84e20912c332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3', 'volume_size': 1, 'source_volid': 'fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c', 'source_volstatus': 'available'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed104fc-a012-4e37-aa71-be40db445f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:48 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d 1073741824 Apr 13 17:27:48 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:48 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Volume volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 (41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3): created successfully Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed104fc-a012-4e37-aa71-be40db445f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Flow 'volume_create_manager' (c5746f52-a82a-4e64-b7dc-22f893210007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:48 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-83eb21ce-fcd8-4ccf-82d1-176ee0a00026 tempest-VolumeDependencyTests-1494736895 None] Created volume successfully. Apr 13 17:27:49 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d 1073741824" returned: 0 in 0.509s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:49 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d Apr 13 17:27:49 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:49 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-quobyte-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d" returned: 0 in 0.451s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.393s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1402286640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61a28f6-ffa2-4226-aa31-a445dd01333e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881bf1b4775f4558a3161bf0d063f973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:42Z,use_quota=True,user_id='ba148f033be44db791d135e83ae29e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Creating volume a61a28f6-ffa2-4226-aa31-a445dd01333e {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:49 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:UPDATE=216,cinder:DELETE=19,cinder:SELECT=160,cinder:INSERT=68 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c" acquired by "delete_volume" :: waited 0.049s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:49 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e 1073741824 Apr 13 17:27:49 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=163,cinder:INSERT=49,cinder:UPDATE=217,cinder:DELETE=17 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de8d0a6-f726-4095-88ee-835a8130308c]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG cinder.volume.volume_utils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Attempting download of 696022cb-dcc0-451a-9908-378fc3a9d5ca ((None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}])) to volume efa0329e-4da2-40b4-94c5-8c7f3234d86d. {{(pid=81998) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dd669a-7140-4bd7-a7ca-7c8022c1c6c5]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_emez37xe {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:49 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c Apr 13 17:27:49 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:50 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_emez37xe Apr 13 17:27:50 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:50 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e 1073741824" returned: 0 in 0.563s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:50 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c" returned: 0 in 0.532s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:50 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c Apr 13 17:27:50 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:50 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e Apr 13 17:27:50 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:50 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_emez37xe" returned: 0 in 0.524s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_emez37xe {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:50 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_emez37xe Apr 13 17:27:50 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:50 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e" returned: 0 in 0.453s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:50 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.348s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-660848129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1c10ee-af3a-4e63-a7f3-d488cc673133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b7d8e53c01492991160c6eb5e377a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:27:46Z,use_quota=True,user_id='24a1658bcb8b4326ab3d9babf3f4078f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Creating volume 9d1c10ee-af3a-4e63-a7f3-d488cc673133 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:27:50 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c" returned: 0 in 0.489s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:50 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133 1073741824 Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6567ccd3-cf1c-4212-b1f2-cec45cc1bb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61a28f6-ffa2-4226-aa31-a445dd01333e', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:50 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad35780d-168a-448e-b1c1-00c74170060a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c" released by "delete_volume" :: held 1.066s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:50 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Volume volume-a61a28f6-ffa2-4226-aa31-a445dd01333e (a61a28f6-ffa2-4226-aa31-a445dd01333e): created successfully Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad35780d-168a-448e-b1c1-00c74170060a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Flow 'volume_create_manager' (496da196-780b-4990-908d-8e9c74c17d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:50 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-5f54e4bd-ce04-473a-b435-d028804c2615 tempest-VolumesExtendTest-1815092270 None] Created volume successfully. Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Created reservations ['78cc76e7-58fb-4f06-80b7-e0fde4bd8813', '7b17ac73-3f07-4b79-80b1-32cd5a39b187', '2fc2f834-f7cf-487e-ae3c-70d71b81abba', '2b6bf04a-0d1b-496f-b5db-9a875621206a'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:50 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_emez37xe" returned: 1 in 0.524s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_emez37xe' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa534473-e3d6-42b7-b307-d0c4ca68abb1]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:51 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:51 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:51 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD Apr 13 17:27:51 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:51 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133 1073741824" returned: 0 in 0.520s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:51 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133 Apr 13 17:27:51 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:51 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.454s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:51 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Deleted volume successfully. Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8c0ed360-55a4-4da2-bc68-df90a8b90fde tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-fb35e352-f3a1-4efe-b1c8-ec0b4a76a05c-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:51 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD" returned: 0 in 0.535s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] 696022cb-dcc0-451a-9908-378fc3a9d5ca was qcow2, converting to raw {{(pid=81998) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:51 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d Apr 13 17:27:51 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:51 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133" returned: 0 in 0.429s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3e6456-a3f2-48e7-9234-ff70baf15a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84311be-3991-45ef-a8ec-ac476366a430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:51 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Volume volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133 (9d1c10ee-af3a-4e63-a7f3-d488cc673133): created successfully Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84311be-3991-45ef-a8ec-ac476366a430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Flow 'volume_create_manager' (968baeaf-1ab1-4636-a545-d7c572a36bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:51 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-7a5c4f8f-45ba-4588-9634-29204295350f tempest-VolumesNegativeTest-932403880 None] Created volume successfully. Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-quobyte-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33a4c07-3abf-477e-856e-f3588750bc75]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:52 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 Apr 13 17:27:52 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] Creating offline snapshot 57db391c-1698-4cb1-b985-88e0a55cd05e of volume a61a28f6-ffa2-4226-aa31-a445dd01333e {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[080f8c0a-a0c2-4e9e-b2f9-bbd48c2e7529]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:52 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e Apr 13 17:27:52 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:52 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d" returned: 0 in 1.024s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_anecojp2devstack@QuobyteHD, size 112.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:27:52 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Converted 112.00 MB image at 109.21 MB/s Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:52 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d 1G Apr 13 17:27:52 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:52 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3" returned: 0 in 0.583s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:52 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3 Apr 13 17:27:52 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:52 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e" returned: 0 in 0.632s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:52 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e 1G Apr 13 17:27:52 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:53 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d 1G" returned: 0 in 0.543s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c282b5e-0040-4891-8003-cd6c8cf1f33d]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:53 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3" returned: 0 in 0.581s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3" released by "delete_volume" :: held 1.193s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Created reservations ['77eb1225-6dd8-424f-ab74-a2b5731bcb3c', '3bc88ee2-c2fc-4b2b-b7d2-746700f47e53', 'fa0fd957-4a05-43b2-b4b2-57ae41998abc', '7881826a-c6cd-44d8-946b-e419460b0e62'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:53 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d Apr 13 17:27:53 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:53 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:53 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:53 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e 1G" returned: 0 in 0.651s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a61a28f6-ffa2-4226-aa31-a445dd01333e -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:53 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a61a28f6-ffa2-4226-aa31-a445dd01333e -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e Apr 13 17:27:53 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:53 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d" returned: 0 in 0.605s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:53 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d Apr 13 17:27:53 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:53 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.538s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:53 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Deleted volume successfully. Apr 13 17:27:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a08b5dd5-f798-4b10-b558-4b500d7144da tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-41fb4aad-fbc5-47b8-bfcf-fada1b2e27b3-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:54 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a61a28f6-ffa2-4226-aa31-a445dd01333e -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e" returned: 0 in 0.549s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:54 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e is being set with open permissions: ugo+rw Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:54 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e Apr 13 17:27:54 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-c7427f1b-b852-45b6-9d7b-a59b289cfa7c-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-c7427f1b-b852-45b6-9d7b-a59b289cfa7c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:54 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "cinder-quobyte-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d" returned: 1 in 0.525s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.volume.volume_utils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Downloaded image 696022cb-dcc0-451a-9908-378fc3a9d5ca ((None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}])) to volume efa0329e-4da2-40b4-94c5-8c7f3234d86d successfully. {{(pid=81998) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Temporary image 696022cb-dcc0-451a-9908-378fc3a9d5ca for user 054b756dd7db4c4792ff2f161ad664ce is deleted. {{(pid=81998) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.volume.volume_utils [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Marking volume efa0329e-4da2-40b4-94c5-8c7f3234d86d as bootable. {{(pid=81998) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Copying metadata from image 696022cb-dcc0-451a-9908-378fc3a9d5ca to efa0329e-4da2-40b4-94c5-8c7f3234d86d. {{(pid=81998) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Creating volume glance metadata for volume efa0329e-4da2-40b4-94c5-8c7f3234d86d backed by image 696022cb-dcc0-451a-9908-378fc3a9d5ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81998) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" acquired by "delete_volume" :: waited 0.028s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2947fc9c-a761-482c-b21d-dbcec605b9cb]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c69b941-8cbe-4f25-a54e-f02c8e4e93ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d', 'volume_size': 1, 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afd653b3e1644792a661ae2b4015619a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'created_at': datetime.datetime(2026, 4, 13, 15, 17, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/696022cb-dcc0-451a-9908-378fc3a9d5ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7e734a-b99b-4afd-8c79-2f4e2ac94663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:27:54 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c Apr 13 17:27:54 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:54 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Volume volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d (efa0329e-4da2-40b4-94c5-8c7f3234d86d): created successfully Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7e734a-b99b-4afd-8c79-2f4e2ac94663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Flow 'volume_create_manager' (d6c262ae-3432-41ef-9b04-8430864ef2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:27:54 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-444c5092-2fef-4c4c-bfa6-26837ba356d5 tempest-VolumesImageMetadata-1844299487 None] Created volume successfully. Apr 13 17:27:54 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e" returned: 0 in 0.512s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:54 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.info Apr 13 17:27:54 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:54 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" returned: 0 in 0.549s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:54 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c Apr 13 17:27:54 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Acquiring lock "cinder-efa0329e-4da2-40b4-94c5-8c7f3234d86d-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Lock "cinder-efa0329e-4da2-40b4-94c5-8c7f3234d86d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Acquiring lock "cinder-quobyte-efa0329e-4da2-40b4-94c5-8c7f3234d86d" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Lock "cinder-quobyte-efa0329e-4da2-40b4-94c5-8c7f3234d86d" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d9e151-c47d-4213-83c3-7cd7eacbed5c]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:55 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.info" returned: 0 in 0.491s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:55 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.info is being set with open permissions: ugo+rw Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:55 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.info Apr 13 17:27:55 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:55 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d Apr 13 17:27:55 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:55 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" returned: 0 in 0.461s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-quobyte-c7427f1b-b852-45b6-9d7b-a59b289cfa7c" released by "delete_volume" :: held 1.053s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Created reservations ['6b4fc3e6-df45-4955-b3f7-33c9700eebe1', '6d63e824-85df-470b-89ea-67987730db1e', 'bf01defc-359e-43ef-9dd4-a09bae640b35', '53a00963-eb59-4839-aa54-529a311f8e14'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:55 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:55 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:55 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.info" returned: 0 in 0.507s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.404s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:55 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-1152f1ca-80d0-4e36-8de5-ee35025de824 tempest-VolumesExtendTest-1815092270 None] Create snapshot completed successfully Apr 13 17:27:55 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d" returned: 0 in 0.559s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:55 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d Apr 13 17:27:55 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:55 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.424s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:55 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Deleted volume successfully. Apr 13 17:27:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1da9bbef-5ac4-4e12-9f6f-5c6c3c912f98 tempest-VolumeDependencyTests-1494736895 None] Lock "cinder-c7427f1b-b852-45b6-9d7b-a59b289cfa7c-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:56 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d" returned: 1 in 0.541s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:56 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d Apr 13 17:27:56 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1af5fe55-81d4-4d49-9818-d71ff9962052 tempest-VolumesExtendTest-1815092270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1af5fe55-81d4-4d49-9818-d71ff9962052 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16da3cc-3cf7-490c-98f3-ca3d5bc71f82]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1af5fe55-81d4-4d49-9818-d71ff9962052 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:56 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e Apr 13 17:27:56 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:56 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-efa0329e-4da2-40b4-94c5-8c7f3234d86d" returned: 0 in 0.517s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Lock "cinder-quobyte-efa0329e-4da2-40b4-94c5-8c7f3234d86d" released by "delete_volume" :: held 1.677s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Created reservations ['56a1df39-1c8a-488b-aeb1-068eeba1569e', '3e427ebe-b132-48b9-abab-0af5b0d240e0', '9862cf07-8510-4128-98cb-127be3c9eecc', '4e12cb01-0fdd-482c-b144-fe93aa35de54'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:56 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:27:56 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:56 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1af5fe55-81d4-4d49-9818-d71ff9962052 tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e" returned: 0 in 0.546s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1af5fe55-81d4-4d49-9818-d71ff9962052 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e 2G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1af5fe55-81d4-4d49-9818-d71ff9962052 tempest-VolumesExtendTest-1815092270 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e 2G" returned: 0 in 0.108s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1af5fe55-81d4-4d49-9818-d71ff9962052 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.676s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:27:57 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-1af5fe55-81d4-4d49-9818-d71ff9962052 tempest-VolumesExtendTest-1815092270 None] Extend volume completed successfully. Apr 13 17:27:57 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.516s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:27:57 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Deleted volume successfully. Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-60d12435-c8f0-4df9-8ada-1d372d5d9190 tempest-VolumesImageMetadata-1844299487 None] Lock "cinder-efa0329e-4da2-40b4-94c5-8c7f3234d86d-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Acquiring lock "cinder-57db391c-1698-4cb1-b985-88e0a55cd05e-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Lock "cinder-57db391c-1698-4cb1-b985-88e0a55cd05e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Acquiring lock "cinder-quobyte-a61a28f6-ffa2-4226-aa31-a445dd01333e" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Lock "cinder-quobyte-a61a28f6-ffa2-4226-aa31-a445dd01333e" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Acquiring lock "cinder-quobyte-57db391c-1698-4cb1-b985-88e0a55cd05e" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Lock "cinder-quobyte-57db391c-1698-4cb1-b985-88e0a55cd05e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Deleting offline snapshot 57db391c-1698-4cb1-b985-88e0a55cd05e of volume a61a28f6-ffa2-4226-aa31-a445dd01333e {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] snapshot_file for this snap is: volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f86460-f874-4b38-934e-34d3771650fb]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:57 devstack sudo[88635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e Apr 13 17:27:57 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:58 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e" returned: 0 in 0.723s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a61a28f6-ffa2-4226-aa31-a445dd01333e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:27:58 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf9c7cf-3ab4-416f-802e-fe6e97dff2f6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:27:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:58 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e Apr 13 17:27:58 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:59 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e" returned: 0 in 0.658s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:59 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e Apr 13 17:27:59 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:27:59 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Apr 13 17:27:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e" returned: 0 in 0.720s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:27:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:27:59 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e Apr 13 17:27:59 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:00 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e.57db391c-1698-4cb1-b985-88e0a55cd05e" returned: 0 in 0.506s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Lock "cinder-quobyte-57db391c-1698-4cb1-b985-88e0a55cd05e" released by "_delete_snapshot" :: held 2.683s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Lock "cinder-quobyte-a61a28f6-ffa2-4226-aa31-a445dd01333e" released by "delete_snapshot" :: held 2.698s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Created reservations ['b9015c5f-0f7e-4732-a656-4983bc4c3e41', '5fc0b6e3-5630-4e7f-8ef8-e5f941affb44', '4cad4157-1282-40ba-a490-543dd552af68', 'ccacb13d-b84e-46e1-a3df-6f0b44ca94bf'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:00 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Delete snapshot completed successfully. Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-495a8c42-070a-45e9-89b3-87ff5f4d31b5 tempest-VolumesExtendTest-1815092270 None] Lock "cinder-57db391c-1698-4cb1-b985-88e0a55cd05e-delete_snapshot" released by "delete_snapshot" :: held 2.837s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Flow 'volume_create_manager' (f341502b-624e-42b4-bff5-48cab5a352c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acbf5ea-ed56-4d1c-83b2-96a83a98eeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acbf5ea-ed56-4d1c-83b2-96a83a98eeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1252382387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6a6baf-7d32-4914-892c-276616640531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07947f544766460182ccb0c9f77552e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:01Z,use_quota=True,user_id='28cbdcf702994e7f95648e501ec04463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c841fad0-8eb2-40f5-8f3e-9d088ae1526d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c841fad0-8eb2-40f5-8f3e-9d088ae1526d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1423476-ca5a-4759-a409-496df321c8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1423476-ca5a-4759-a409-496df321c8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f6a6baf-7d32-4914-892c-276616640531', 'volume_name': 'volume-1f6a6baf-7d32-4914-892c-276616640531', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2908933d-7719-4208-be76-1beee2f96e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2908933d-7719-4208-be76-1beee2f96e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72e6a0f-3f7b-46e6-a77a-f8a6862b294c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:00 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Volume 1f6a6baf-7d32-4914-892c-276616640531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f6a6baf-7d32-4914-892c-276616640531', 'volume_size': 1} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1252382387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6a6baf-7d32-4914-892c-276616640531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07947f544766460182ccb0c9f77552e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:01Z,use_quota=True,user_id='28cbdcf702994e7f95648e501ec04463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Creating volume 1f6a6baf-7d32-4914-892c-276616640531 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:28:00 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1f6a6baf-7d32-4914-892c-276616640531 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:00 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1f6a6baf-7d32-4914-892c-276616640531 1073741824 Apr 13 17:28:00 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Acquiring lock "cinder-a61a28f6-ffa2-4226-aa31-a445dd01333e-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Lock "cinder-a61a28f6-ffa2-4226-aa31-a445dd01333e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Acquiring lock "cinder-quobyte-a61a28f6-ffa2-4226-aa31-a445dd01333e" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Lock "cinder-quobyte-a61a28f6-ffa2-4226-aa31-a445dd01333e" acquired by "delete_volume" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24e408e-eaa6-486a-a179-1802b8af49bb]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:01 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e Apr 13 17:28:01 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:01 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1f6a6baf-7d32-4914-892c-276616640531 1073741824" returned: 0 in 0.612s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1f6a6baf-7d32-4914-892c-276616640531 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:01 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1f6a6baf-7d32-4914-892c-276616640531 Apr 13 17:28:01 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:01 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e" returned: 0 in 0.617s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:01 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e Apr 13 17:28:01 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:01 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1f6a6baf-7d32-4914-892c-276616640531" returned: 0 in 0.510s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:28:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72e6a0f-3f7b-46e6-a77a-f8a6862b294c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6a6baf-7d32-4914-892c-276616640531', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e3547c-fa97-402f-b05a-54823cd4b676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:01 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Volume volume-1f6a6baf-7d32-4914-892c-276616640531 (1f6a6baf-7d32-4914-892c-276616640531): created successfully Apr 13 17:28:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e3547c-fa97-402f-b05a-54823cd4b676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Flow 'volume_create_manager' (f341502b-624e-42b4-bff5-48cab5a352c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:01 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-24a95571-c702-4a39-8ba8-919d2c736e07 tempest-VolumesTransfersTest-1359398351 None] Created volume successfully. Apr 13 17:28:02 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a61a28f6-ffa2-4226-aa31-a445dd01333e" returned: 0 in 0.516s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Lock "cinder-quobyte-a61a28f6-ffa2-4226-aa31-a445dd01333e" released by "delete_volume" :: held 1.168s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:02 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Created reservations ['9208d9cb-30cb-4cab-a389-17dd06bcdc51', 'e3c02841-991f-4ec4-ad48-23761517f32f', '3a924efa-35ea-4df0-b37b-ddc5308c8042', 'c52c73c3-d95f-4dfc-9712-381730fc1c61'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:02 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:28:02 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:02 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.555s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:02 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:28:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Deleted volume successfully. Apr 13 17:28:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-a0459b6b-021b-4f20-bd8a-6b0fcbd98825 tempest-VolumesExtendTest-1815092270 None] Lock "cinder-a61a28f6-ffa2-4226-aa31-a445dd01333e-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:03 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-abe1ef9f-60f0-4dd9-8ec2-44308483d7b7 tempest-VolumesTransfersTest-1288684719 None] Transfer volume completed successfully. Apr 13 17:28:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Acquiring lock "cinder-1f6a6baf-7d32-4914-892c-276616640531-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Lock "cinder-1f6a6baf-7d32-4914-892c-276616640531-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Acquiring lock "cinder-quobyte-1f6a6baf-7d32-4914-892c-276616640531" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Lock "cinder-quobyte-1f6a6baf-7d32-4914-892c-276616640531" acquired by "delete_volume" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:04 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5638e7f7-771b-4a13-bcee-b384f598b1c3]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1f6a6baf-7d32-4914-892c-276616640531 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:04 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1f6a6baf-7d32-4914-892c-276616640531 Apr 13 17:28:04 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:05 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1f6a6baf-7d32-4914-892c-276616640531" returned: 0 in 0.813s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1f6a6baf-7d32-4914-892c-276616640531 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:05 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1f6a6baf-7d32-4914-892c-276616640531 Apr 13 17:28:05 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Flow 'volume_create_manager' (35de552d-44d2-422d-ab2f-ba95adfc2f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3771552-eec6-4c4b-aff7-eb0f4026dfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3771552-eec6-4c4b-aff7-eb0f4026dfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1356796330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d83e39-5033-4cad-9b4f-0e9ea0d479d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a90d97cc2b45ebb99b4914ffb031a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:06Z,use_quota=True,user_id='9a349ba71e5f4e28b8125158e91ac69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615a142e-8b65-44b1-9e2c-237df042b5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615a142e-8b65-44b1-9e2c-237df042b5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:06 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295a17cf-2a76-42b8-97c6-eb075123bca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295a17cf-2a76-42b8-97c6-eb075123bca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d83e39-5033-4cad-9b4f-0e9ea0d479d9', 'volume_name': 'volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9', 'volume_size': 2}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae287d7-8258-49c1-b274-aa08216e2d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae287d7-8258-49c1-b274-aa08216e2d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9052b5-1ef9-420d-9eec-573ba62d5d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:06 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Volume 65d83e39-5033-4cad-9b4f-0e9ea0d479d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9', 'volume_size': 2} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1356796330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d83e39-5033-4cad-9b4f-0e9ea0d479d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a90d97cc2b45ebb99b4914ffb031a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:06Z,use_quota=True,user_id='9a349ba71e5f4e28b8125158e91ac69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Creating volume 65d83e39-5033-4cad-9b4f-0e9ea0d479d9 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:28:06 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 2147483648 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1f6a6baf-7d32-4914-892c-276616640531" returned: 0 in 0.764s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Lock "cinder-quobyte-1f6a6baf-7d32-4914-892c-276616640531" released by "delete_volume" :: held 1.621s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:06 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 2147483648 Apr 13 17:28:06 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Created reservations ['b4d85a88-3487-4cc1-8e17-784e29ce85d0', '1791ba0c-3380-4787-852b-ef8657212dc1', '01a358f4-6991-4eee-a1f8-087ef9477b64', 'd5957e52-337f-4278-9dbf-9c99bce478fc'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:06 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:28:06 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 2147483648" returned: 0 in 0.930s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:07 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:07 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.866s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:28:07 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 Apr 13 17:28:07 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:07 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Deleted volume successfully. Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4e8f3c-e476-48c9-bb99-2b24d5ca7314 tempest-VolumesTransfersTest-1959913797 None] Lock "cinder-1f6a6baf-7d32-4914-892c-276616640531-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Flow 'volume_create_manager' (93427de4-9aba-4315-96c2-63f224c642b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c6bb0d-3cd5-4db0-9540-83b88683cf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c6bb0d-3cd5-4db0-9540-83b88683cf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-872075498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b6ef1d-33ba-453e-9299-ca6824f82b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07947f544766460182ccb0c9f77552e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:07Z,use_quota=True,user_id='28cbdcf702994e7f95648e501ec04463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340f34fe-c621-483e-b2d1-6781bf802946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340f34fe-c621-483e-b2d1-6781bf802946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164d741c-0469-4e68-87c5-73eaa3fec7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164d741c-0469-4e68-87c5-73eaa3fec7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b6ef1d-33ba-453e-9299-ca6824f82b9e', 'volume_name': 'volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7dfade-3b13-4b54-90bc-3621cfd0fa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7dfade-3b13-4b54-90bc-3621cfd0fa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0a1145-0afe-445d-baa6-d4e5749b8e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:07 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Volume f9b6ef1d-33ba-453e-9299-ca6824f82b9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e', 'volume_size': 1} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:07 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9" returned: 0 in 0.505s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.298s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-872075498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b6ef1d-33ba-453e-9299-ca6824f82b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07947f544766460182ccb0c9f77552e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:07Z,use_quota=True,user_id='28cbdcf702994e7f95648e501ec04463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Creating volume f9b6ef1d-33ba-453e-9299-ca6824f82b9e {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:28:07 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9052b5-1ef9-420d-9eec-573ba62d5d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9', 'volume_size': 2}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:07 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e 1073741824 Apr 13 17:28:07 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95748a7-a5cf-4c4c-9736-655b3af2801e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:07 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Volume volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 (65d83e39-5033-4cad-9b4f-0e9ea0d479d9): created successfully Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95748a7-a5cf-4c4c-9736-655b3af2801e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Flow 'volume_create_manager' (35de552d-44d2-422d-ab2f-ba95adfc2f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:07 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e6b1a5f8-381e-4256-8a89-8528dccae2ae tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Created volume successfully. Apr 13 17:28:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:08 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e 1073741824" returned: 0 in 0.958s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:08 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e Apr 13 17:28:08 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:09 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e" returned: 0 in 0.481s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.584s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Creating offline snapshot da53587d-3b56-43df-84fe-fd7fe0e1fb8b of volume 65d83e39-5033-4cad-9b4f-0e9ea0d479d9 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0a1145-0afe-445d-baa6-d4e5749b8e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa06010a-7022-484a-8069-14fd379b56db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[df56dd16-5466-4367-b0a8-934694807974]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:09 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Volume volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e (f9b6ef1d-33ba-453e-9299-ca6824f82b9e): created successfully Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa06010a-7022-484a-8069-14fd379b56db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Flow 'volume_create_manager' (93427de4-9aba-4315-96c2-63f224c642b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:09 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-6a574cec-9d78-48e2-a606-dbf59d89a2f7 tempest-VolumesTransfersTest-1359398351 None] Created volume successfully. Apr 13 17:28:09 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 Apr 13 17:28:09 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Acquiring lock "cinder-f9b6ef1d-33ba-453e-9299-ca6824f82b9e-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Lock "cinder-f9b6ef1d-33ba-453e-9299-ca6824f82b9e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:09 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Acquiring lock "cinder-quobyte-f9b6ef1d-33ba-453e-9299-ca6824f82b9e" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9" returned: 0 in 0.718s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b 2G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Lock "cinder-quobyte-f9b6ef1d-33ba-453e-9299-ca6824f82b9e" acquired by "delete_volume" :: waited 0.020s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:09 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b 2G Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e08508-153c-4972-8234-bb1d96c76f78]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:09 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:10 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e Apr 13 17:28:10 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:10 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e" returned: 0 in 0.593s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:10 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e Apr 13 17:28:10 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:10 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b 2G" returned: 0 in 0.670s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:10 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b Apr 13 17:28:10 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:11 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f9b6ef1d-33ba-453e-9299-ca6824f82b9e" returned: 0 in 0.559s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Lock "cinder-quobyte-f9b6ef1d-33ba-453e-9299-ca6824f82b9e" released by "delete_volume" :: held 1.190s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Created reservations ['bfef1beb-2667-4371-8e57-d8a8142d78d6', '178e9e00-db54-4833-97b3-da5593cd7b29', '01db9a4d-d5a1-4748-b0f8-cf8c27a5b266', 'e7bf3e11-11f5-4a35-82ee-5a0ac0c23348'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:11 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:28:11 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:11 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b" returned: 0 in 0.647s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:11 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b is being set with open permissions: ugo+rw Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:11 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b Apr 13 17:28:11 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:11 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.505s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:28:11 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:11 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Deleted volume successfully. Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b" returned: 0 in 0.486s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8f766a26-bd4d-46eb-80a1-85811dd0e0f8 tempest-VolumesTransfersTest-1959913797 None] Lock "cinder-f9b6ef1d-33ba-453e-9299-ca6824f82b9e-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:11 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.info Apr 13 17:28:11 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:12 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.info" returned: 0 in 0.625s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:12 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.info is being set with open permissions: ugo+rw Apr 13 17:28:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:12 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.info Apr 13 17:28:12 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:12 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.info" returned: 0 in 0.525s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.763s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:12 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-a4436d4b-3302-443a-ab8d-993079b4b01a tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Create snapshot completed successfully Apr 13 17:28:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Acquiring lock "cinder-da53587d-3b56-43df-84fe-fd7fe0e1fb8b-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "cinder-da53587d-3b56-43df-84fe-fd7fe0e1fb8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Acquiring lock "cinder-quobyte-65d83e39-5033-4cad-9b4f-0e9ea0d479d9" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "cinder-quobyte-65d83e39-5033-4cad-9b4f-0e9ea0d479d9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Acquiring lock "cinder-quobyte-da53587d-3b56-43df-84fe-fd7fe0e1fb8b" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "cinder-quobyte-da53587d-3b56-43df-84fe-fd7fe0e1fb8b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Deleting offline snapshot da53587d-3b56-43df-84fe-fd7fe0e1fb8b of volume 65d83e39-5033-4cad-9b4f-0e9ea0d479d9 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:28:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] snapshot_file for this snap is: volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:28:13 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c6365e-3cdd-428a-bfa8-a250b487cca2]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:14 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b Apr 13 17:28:14 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:14 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b" returned: 0 in 0.735s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:14 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:28:14 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1396a434-28d0-411e-abac-1961d0de4408]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:14 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 Apr 13 17:28:14 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:15 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9" returned: 0 in 0.627s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:15 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b Apr 13 17:28:15 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:15 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b" returned: 0 in 0.693s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:15 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b Apr 13 17:28:15 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:16 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9.da53587d-3b56-43df-84fe-fd7fe0e1fb8b" returned: 0 in 0.485s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "cinder-quobyte-da53587d-3b56-43df-84fe-fd7fe0e1fb8b" released by "_delete_snapshot" :: held 2.755s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "cinder-quobyte-65d83e39-5033-4cad-9b4f-0e9ea0d479d9" released by "delete_snapshot" :: held 2.775s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Flow 'volume_create_manager' (62b1c6cb-ae4a-4d45-b049-ea748072d1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9d8956-9b73-41a7-9259-dd7cc6762648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9d8956-9b73-41a7-9259-dd7cc6762648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-311356966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3d77c3-c224-47c7-92d1-b811fe7c61f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30facacaa7324a97a3288e3f3a93654f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:17Z,use_quota=True,user_id='b71343ff44b943618e93587e0f55aa36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b06e2fd-020c-4449-9ade-e169d9a617c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b06e2fd-020c-4449-9ade-e169d9a617c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2d70b7-7422-4ed7-810c-b8b4ad242436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2d70b7-7422-4ed7-810c-b8b4ad242436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b3d77c3-c224-47c7-92d1-b811fe7c61f5', 'volume_name': 'volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23687fad-fd41-44b7-aa11-276a154b26ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23687fad-fd41-44b7-aa11-276a154b26ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7da91a-ac6b-4b41-aed6-18d4f09a8115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:16 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Volume 3b3d77c3-c224-47c7-92d1-b811fe7c61f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5', 'volume_size': 1} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-311356966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3d77c3-c224-47c7-92d1-b811fe7c61f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30facacaa7324a97a3288e3f3a93654f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:17Z,use_quota=True,user_id='b71343ff44b943618e93587e0f55aa36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Creating volume 3b3d77c3-c224-47c7-92d1-b811fe7c61f5 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:28:16 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:16 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 1073741824 Apr 13 17:28:16 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Created reservations ['6b88dfbd-1830-4e84-8be7-f07e66e433c5', '7212fb8d-bc68-4b75-8eab-b6bbdfe3a4f9', 'd3f09911-a533-43d3-80a7-6949ab6b8df4', '8a2b1981-44c1-4ad3-9ca0-93f26647ad73'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:16 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Delete snapshot completed successfully. Apr 13 17:28:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-fe54b5c5-aede-404a-a612-89df47706a23 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "cinder-da53587d-3b56-43df-84fe-fd7fe0e1fb8b-delete_snapshot" released by "delete_snapshot" :: held 3.028s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:17 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Acquiring lock "cinder-65d83e39-5033-4cad-9b4f-0e9ea0d479d9-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:17 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "cinder-65d83e39-5033-4cad-9b4f-0e9ea0d479d9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:17 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Acquiring lock "cinder-quobyte-65d83e39-5033-4cad-9b4f-0e9ea0d479d9" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:17 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "cinder-quobyte-65d83e39-5033-4cad-9b4f-0e9ea0d479d9" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:17 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a9299a-9b1b-49b4-ba6b-402e734e16ce]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:17 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 Apr 13 17:28:17 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:17 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 1073741824" returned: 0 in 0.782s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:17 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 Apr 13 17:28:17 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:17 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9" returned: 0 in 0.728s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:17 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9 Apr 13 17:28:17 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:18 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" returned: 0 in 0.579s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7da91a-ac6b-4b41-aed6-18d4f09a8115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fef54f-e77b-4553-9c2a-aeee927c1977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:18 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Volume volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 (3b3d77c3-c224-47c7-92d1-b811fe7c61f5): created successfully Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fef54f-e77b-4553-9c2a-aeee927c1977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Flow 'volume_create_manager' (62b1c6cb-ae4a-4d45-b049-ea748072d1f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:18 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-c81cedf6-a628-4ca9-97ed-f82af409d86a tempest-SnapshotDependencyTests-1563336915 None] Created volume successfully. Apr 13 17:28:18 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-65d83e39-5033-4cad-9b4f-0e9ea0d479d9" returned: 0 in 0.570s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "cinder-quobyte-65d83e39-5033-4cad-9b4f-0e9ea0d479d9" released by "delete_volume" :: held 1.342s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Created reservations ['a5df2ca5-3158-415f-805d-932c73e0013c', '4c79dd97-2f58-467d-914d-bdd916eb4b59', 'd9388bf5-b05f-480b-bf96-8ca7151bf5d5', 'f8b1144d-8c8e-46ef-a658-c79e57a2bd29'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:18 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:28:18 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] Creating offline snapshot ea6b3e05-2978-4f94-a999-be106fd3f6ea of volume 3b3d77c3-c224-47c7-92d1-b811fe7c61f5 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:28:19 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91c9c75-5bab-4326-80ef-d432b4513b37]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:19 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 Apr 13 17:28:19 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:19 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.587s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:19 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:28:19 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Deleted volume successfully. Apr 13 17:28:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e19e5ff9-e6cc-496a-b261-839aa30759c1 tempest-VolumesSnapshotNegativeTestJSON-1830576577 None] Lock "cinder-65d83e39-5033-4cad-9b4f-0e9ea0d479d9-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:19 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" returned: 0 in 0.675s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:19 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea 1G Apr 13 17:28:19 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Flow 'volume_create_manager' (75036422-1e78-47a8-849f-1ecd4049a8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a80d1a-1645-4841-9383-d82838878205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a80d1a-1645-4841-9383-d82838878205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-480076780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea4601b-6eee-4ea2-9f11-bb77ba19f417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d10fc04ec39489ba0ca8f5b9d56978b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:20Z,use_quota=True,user_id='8f268edabc7546fd9162a05ba076f508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d7b9be-7e24-422d-bce9-3f5f4e1d6de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d7b9be-7e24-422d-bce9-3f5f4e1d6de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2fb5ac-2343-43d4-ae5f-52d2439e4663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2fb5ac-2343-43d4-ae5f-52d2439e4663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea4601b-6eee-4ea2-9f11-bb77ba19f417', 'volume_name': 'volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8775a60c-1384-45c4-9abf-d50e77cf10b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8775a60c-1384-45c4-9abf-d50e77cf10b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3d99e8-126f-4f36-a117-c01c721ac157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:20 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Volume 7ea4601b-6eee-4ea2-9f11-bb77ba19f417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417', 'volume_size': 1} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Acquiring lock "cinder-9d1c10ee-af3a-4e63-a7f3-d488cc673133-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:20 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Lock "cinder-9d1c10ee-af3a-4e63-a7f3-d488cc673133-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea 1G" returned: 0 in 0.763s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:20 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea Apr 13 17:28:20 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Acquiring lock "cinder-quobyte-9d1c10ee-af3a-4e63-a7f3-d488cc673133" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Lock "cinder-quobyte-9d1c10ee-af3a-4e63-a7f3-d488cc673133" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bae18a-a7d8-4c85-ac10-9ab2da44fa0e]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:20 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133 Apr 13 17:28:20 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:21 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea" returned: 0 in 0.459s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:21 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea is being set with open permissions: ugo+rw Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:21 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea Apr 13 17:28:21 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:21 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133" returned: 0 in 0.483s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:21 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133 Apr 13 17:28:21 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:21 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea" returned: 0 in 0.432s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:21 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9d1c10ee-af3a-4e63-a7f3-d488cc673133" returned: 0 in 0.433s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:21 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.info Apr 13 17:28:21 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Lock "cinder-quobyte-9d1c10ee-af3a-4e63-a7f3-d488cc673133" released by "delete_volume" :: held 0.957s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Created reservations ['8562b59c-e2aa-4d11-9ee6-862a67469d7a', '03d9fae2-75b2-4881-b1b8-5b893add2306', 'e4157c09-c5c2-43f0-b69d-ff9c704de9a3', '80323ce8-54dc-486a-acde-1094fba26ad7'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:21 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:28:21 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:21 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.info" returned: 0 in 0.432s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:21 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.info is being set with open permissions: ugo+rw Apr 13 17:28:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:21 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.info Apr 13 17:28:21 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:22 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.418s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:28:22 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Deleted volume successfully. Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1f04c431-7f88-4040-9e26-caafa7a3da94 tempest-VolumesNegativeTest-932403880 None] Lock "cinder-9d1c10ee-af3a-4e63-a7f3-d488cc673133-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:22 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.info" returned: 0 in 0.437s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.324s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.189s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-480076780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea4601b-6eee-4ea2-9f11-bb77ba19f417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d10fc04ec39489ba0ca8f5b9d56978b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:20Z,use_quota=True,user_id='8f268edabc7546fd9162a05ba076f508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Creating volume 7ea4601b-6eee-4ea2-9f11-bb77ba19f417 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:28:22 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:22 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417 1073741824 Apr 13 17:28:22 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:22 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-8e0f85ce-f0a3-472c-bfba-81f56345b66c tempest-SnapshotDependencyTests-1563336915 None] Create snapshot completed successfully Apr 13 17:28:22 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417 1073741824" returned: 0 in 0.555s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:23 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417 Apr 13 17:28:23 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:23 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Flow 'volume_create_manager' (8835b2f9-637a-4aff-8a8a-c9159f1c947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf7eb26-682f-4dd9-82c5-4c9d40c1edbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417" returned: 0 in 0.648s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf7eb26-682f-4dd9-82c5-4c9d40c1edbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd355067-6744-461c-9b5d-125f86afa4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30facacaa7324a97a3288e3f3a93654f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ea6b3e05-2978-4f94-a999-be106fd3f6ea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:24Z,use_quota=True,user_id='b71343ff44b943618e93587e0f55aa36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b581e4da-d94b-495b-9e3c-e2d780b653f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b581e4da-d94b-495b-9e3c-e2d780b653f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdc86a3-62f7-4966-985d-0bfb938d4630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdc86a3-62f7-4966-985d-0bfb938d4630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dd355067-6744-461c-9b5d-125f86afa4f6', 'volume_name': 'volume-dd355067-6744-461c-9b5d-125f86afa4f6', 'volume_size': 1, 'snapshot_id': 'ea6b3e05-2978-4f94-a999-be106fd3f6ea'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b8d0f-f7b0-43a1-9afc-3ee46a789dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b8d0f-f7b0-43a1-9afc-3ee46a789dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (270a3a43-d2d6-4894-90ed-fde167069df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:23 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Volume dd355067-6744-461c-9b5d-125f86afa4f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dd355067-6744-461c-9b5d-125f86afa4f6', 'volume_size': 1, 'snapshot_id': 'ea6b3e05-2978-4f94-a999-be106fd3f6ea'} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "cinder-quobyte-ea6b3e05-2978-4f94-a999-be106fd3f6ea-dd355067-6744-461c-9b5d-125f86afa4f6" by "_create_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3d99e8-126f-4f36-a117-c01c721ac157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb04d0c-0e73-4190-a5ae-8f962118945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-quobyte-ea6b3e05-2978-4f94-a999-be106fd3f6ea-dd355067-6744-461c-9b5d-125f86afa4f6" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Creating volume dd355067-6744-461c-9b5d-125f86afa4f6 from snapshot ea6b3e05-2978-4f94-a999-be106fd3f6ea {{(pid=81998) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "cinder-quobyte-dd355067-6744-461c-9b5d-125f86afa4f6" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:23 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Volume volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417 (7ea4601b-6eee-4ea2-9f11-bb77ba19f417): created successfully Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb04d0c-0e73-4190-a5ae-8f962118945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Flow 'volume_create_manager' (75036422-1e78-47a8-849f-1ecd4049a8b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:23 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-4289efb1-127b-452f-9087-d9b1e96683aa tempest-VolumesTransfersV357Test-1660027954 None] Created volume successfully. Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-quobyte-dd355067-6744-461c-9b5d-125f86afa4f6" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] snapshot: ea6b3e05-2978-4f94-a999-be106fd3f6ea, volume: dd355067-6744-461c-9b5d-125f86afa4f6, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cca2e02-2169-4e04-96c6-cf6080f6dda6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:23 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea Apr 13 17:28:23 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:24 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea" returned: 0 in 0.589s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09c47b3-7251-46fd-b368-f4a17ce3a1ed]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:24 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 Apr 13 17:28:24 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Flow 'volume_create_manager' (441f4bfb-7422-4709-b238-9bc0f07e9db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac1d173-bc69-4798-b922-8cbfd578d4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac1d173-bc69-4798-b922-8cbfd578d4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-291399657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36e219d-dc90-4716-a93d-0b0a90943268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d675aca06e554ca3987d6ac94758ba92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:25Z,use_quota=True,user_id='4becfa5e347040d482453c93a0520b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d9b566-0b97-42b1-bcf6-da8d0cd6b452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d9b566-0b97-42b1-bcf6-da8d0cd6b452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b3f3a4-b5c4-4c57-ad5c-b6fccf25fe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b3f3a4-b5c4-4c57-ad5c-b6fccf25fe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36e219d-dc90-4716-a93d-0b0a90943268', 'volume_name': 'volume-d36e219d-dc90-4716-a93d-0b0a90943268', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd1e142-c404-4405-8019-337716020b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd1e142-c404-4405-8019-337716020b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6d60cf-0707-47fb-98eb-0e1bc9e64d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:24 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Volume d36e219d-dc90-4716-a93d-0b0a90943268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36e219d-dc90-4716-a93d-0b0a90943268', 'volume_size': 1} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:24 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-79ecbe7c-0a86-4697-a27b-0f72a6e632b5 tempest-VolumesTransfersV357Test-103566846 None] Transfer volume completed successfully. Apr 13 17:28:24 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" returned: 0 in 0.589s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6 not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:28:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:25 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6 Apr 13 17:28:25 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Acquiring lock "cinder-7ea4601b-6eee-4ea2-9f11-bb77ba19f417-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Lock "cinder-7ea4601b-6eee-4ea2-9f11-bb77ba19f417-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Acquiring lock "cinder-quobyte-7ea4601b-6eee-4ea2-9f11-bb77ba19f417" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Lock "cinder-quobyte-7ea4601b-6eee-4ea2-9f11-bb77ba19f417" acquired by "delete_volume" :: waited 0.025s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:26 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59002b5-f56d-48d8-9dd0-c84ee0707221]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:26 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417 Apr 13 17:28:26 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:27 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6" returned: 0 in 2.361s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:27 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[185f54b4-a2fe-4f2b-88ee-9b3ee8a2fd90]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:27 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 Apr 13 17:28:27 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:27 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417" returned: 0 in 1.131s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:27 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417 Apr 13 17:28:27 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:27 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7ea4601b-6eee-4ea2-9f11-bb77ba19f417" returned: 0 in 0.487s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Lock "cinder-quobyte-7ea4601b-6eee-4ea2-9f11-bb77ba19f417" released by "delete_volume" :: held 1.656s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Created reservations ['db8a8494-c278-4acb-8d37-909fc1265676', '40c07381-783b-4a90-a56f-d5c1e260ae8c', 'c21d7e0d-dc56-4f90-9a0c-29df1a58e3b7', 'aedcf316-7e8b-4b86-98af-8ca37ebfe72e'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:28 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" returned: 0 in 0.704s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6 {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:28:28 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Converted 1024.00 MB image at 433.41 MB/s Apr 13 17:28:28 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6 is being set with open permissions: ugo+rw Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:28 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6 Apr 13 17:28:28 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:28 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:28:28 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:28 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6" returned: 0 in 0.441s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-quobyte-dd355067-6744-461c-9b5d-125f86afa4f6" released by "_copy_volume_from_snapshot" :: held 4.754s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-quobyte-ea6b3e05-2978-4f94-a999-be106fd3f6ea-dd355067-6744-461c-9b5d-125f86afa4f6" released by "_create_volume_from_snapshot" :: held 4.793s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.814s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.891s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-291399657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36e219d-dc90-4716-a93d-0b0a90943268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d675aca06e554ca3987d6ac94758ba92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:25Z,use_quota=True,user_id='4becfa5e347040d482453c93a0520b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Creating volume d36e219d-dc90-4716-a93d-0b0a90943268 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:28:28 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:28 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 1073741824 Apr 13 17:28:28 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (270a3a43-d2d6-4894-90ed-fde167069df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd355067-6744-461c-9b5d-125f86afa4f6', 'volume_size': 1, 'snapshot_id': 'ea6b3e05-2978-4f94-a999-be106fd3f6ea'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6083176b-4c19-40b5-9e4e-5abdd235cbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:28 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Volume volume-dd355067-6744-461c-9b5d-125f86afa4f6 (dd355067-6744-461c-9b5d-125f86afa4f6): created successfully Apr 13 17:28:28 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6083176b-4c19-40b5-9e4e-5abdd235cbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Flow 'volume_create_manager' (8835b2f9-637a-4aff-8a8a-c9159f1c947c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.516s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:28:28 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Deleted volume successfully. Apr 13 17:28:28 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-6aa96709-2bf1-43d5-9ad2-fc57b6ae9526 tempest-SnapshotDependencyTests-1563336915 None] Created volume successfully. Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-87ccb390-2266-4f12-aabd-e069cb1fc6a0 tempest-VolumesTransfersV357Test-1043966893 None] Lock "cinder-7ea4601b-6eee-4ea2-9f11-bb77ba19f417-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Flow 'volume_create_manager' (60f6cb3d-63d3-46e2-89ad-e85fb6e3c069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d6488c-133a-48e1-8e7c-306520bc1d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d6488c-133a-48e1-8e7c-306520bc1d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1395471426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4a7fba-dc01-4e6b-8d37-e48cad9e970b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d10fc04ec39489ba0ca8f5b9d56978b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:29Z,use_quota=True,user_id='8f268edabc7546fd9162a05ba076f508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d722938-d10c-4a4b-9027-a4df2eeb0fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d722938-d10c-4a4b-9027-a4df2eeb0fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66600e25-ed7e-4335-ae74-34ab4429a0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66600e25-ed7e-4335-ae74-34ab4429a0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e4a7fba-dc01-4e6b-8d37-e48cad9e970b', 'volume_name': 'volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ffec01-1368-408c-9b10-cc13b37527d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ffec01-1368-408c-9b10-cc13b37527d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e864b0c-0036-4ba5-8499-00925faf5782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:28 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Volume 7e4a7fba-dc01-4e6b-8d37-e48cad9e970b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b', 'volume_size': 1} Apr 13 17:28:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "cinder-ea6b3e05-2978-4f94-a999-be106fd3f6ea-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-ea6b3e05-2978-4f94-a999-be106fd3f6ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "cinder-quobyte-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-quobyte-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "cinder-quobyte-ea6b3e05-2978-4f94-a999-be106fd3f6ea" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-quobyte-ea6b3e05-2978-4f94-a999-be106fd3f6ea" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Deleting offline snapshot ea6b3e05-2978-4f94-a999-be106fd3f6ea of volume 3b3d77c3-c224-47c7-92d1-b811fe7c61f5 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] snapshot_file for this snap is: volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6b1fb4-bc5c-4e97-b230-11420bfc8352]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:29 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 1073741824" returned: 0 in 0.580s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:29 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 Apr 13 17:28:29 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:29 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea Apr 13 17:28:29 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:29 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268" returned: 0 in 0.427s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1395471426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4a7fba-dc01-4e6b-8d37-e48cad9e970b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d10fc04ec39489ba0ca8f5b9d56978b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:29Z,use_quota=True,user_id='8f268edabc7546fd9162a05ba076f508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Creating volume 7e4a7fba-dc01-4e6b-8d37-e48cad9e970b {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:29 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:28:29 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea" returned: 0 in 0.497s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:28:29 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b 1073741824 Apr 13 17:28:29 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6d60cf-0707-47fb-98eb-0e1bc9e64d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36e219d-dc90-4716-a93d-0b0a90943268', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac493ec0-1b0c-48ff-a6db-30d8c7948964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7090a9-cf72-451f-8203-e12faf2a4224]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:29 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Volume volume-d36e219d-dc90-4716-a93d-0b0a90943268 (d36e219d-dc90-4716-a93d-0b0a90943268): created successfully Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac493ec0-1b0c-48ff-a6db-30d8c7948964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Flow 'volume_create_manager' (441f4bfb-7422-4709-b238-9bc0f07e9db6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:29 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-4549bc9e-f2cc-436f-a4bd-a6b1cfa226b0 tempest-VolumesSnapshotListTestJSON-602015423 None] Created volume successfully. Apr 13 17:28:29 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 Apr 13 17:28:29 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:30 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b 1073741824" returned: 0 in 0.596s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:30 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b Apr 13 17:28:30 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:30 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" returned: 0 in 0.621s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:30 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea Apr 13 17:28:30 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:30 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b" returned: 0 in 0.441s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.553s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] Creating offline snapshot 188da1f9-f3b4-47bd-b60b-33364a7cb15f of volume d36e219d-dc90-4716-a93d-0b0a90943268 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb83b2b-801c-4987-8473-0b2c85d3ccaf]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e864b0c-0036-4ba5-8499-00925faf5782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6916a769-11df-4e78-bc84-fc88f41419a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:30 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Volume volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b (7e4a7fba-dc01-4e6b-8d37-e48cad9e970b): created successfully Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6916a769-11df-4e78-bc84-fc88f41419a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Flow 'volume_create_manager' (60f6cb3d-63d3-46e2-89ad-e85fb6e3c069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:30 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea" returned: 0 in 0.504s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:30 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b918b363-a384-4efb-b9c4-279ba9c38ad5 tempest-VolumesTransfersV357Test-1660027954 None] Created volume successfully. Apr 13 17:28:30 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 Apr 13 17:28:30 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:30 devstack sudo[88976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea Apr 13 17:28:30 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:31 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5.ea6b3e05-2978-4f94-a999-be106fd3f6ea" returned: 0 in 0.438s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-quobyte-ea6b3e05-2978-4f94-a999-be106fd3f6ea" released by "_delete_snapshot" :: held 2.139s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-quobyte-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" released by "delete_snapshot" :: held 2.153s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:31 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268" returned: 0 in 0.548s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:31 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f 1G Apr 13 17:28:31 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:31 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Created reservations ['354e930e-ff8d-4bcc-9108-77d6542b272e', '9f5fa781-3556-491c-b683-4b618c4d2b5e', '1d01bb45-570c-4c04-8a40-d0c22e0c532c', 'ce7077e2-e652-4687-9fdc-56c175138049'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:31 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Delete snapshot completed successfully. Apr 13 17:28:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-af4f3ac5-0a3e-44b1-b975-9329c05e4b45 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-ea6b3e05-2978-4f94-a999-be106fd3f6ea-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:31 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f 1G" returned: 0 in 0.505s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36e219d-dc90-4716-a93d-0b0a90943268 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:31 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36e219d-dc90-4716-a93d-0b0a90943268 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f Apr 13 17:28:31 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Acquiring lock "cinder-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Lock "cinder-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Acquiring lock "cinder-quobyte-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Lock "cinder-quobyte-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b" acquired by "delete_volume" :: waited 0.020s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ed7f59-56ae-4a98-8f6f-f1f054b9ade0]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "cinder-3b3d77c3-c224-47c7-92d1-b811fe7c61f5-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-3b3d77c3-c224-47c7-92d1-b811fe7c61f5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "cinder-quobyte-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:32 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b Apr 13 17:28:32 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-quobyte-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f373170-8a9f-4976-b1b2-e640904f5f38]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:32 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36e219d-dc90-4716-a93d-0b0a90943268 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f" returned: 0 in 0.575s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:32 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f is being set with open permissions: ugo+rw Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:32 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f Apr 13 17:28:32 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:32 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 Apr 13 17:28:32 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:32 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b" returned: 0 in 0.605s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:32 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b Apr 13 17:28:32 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:32 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f" returned: 0 in 0.474s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:32 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.info Apr 13 17:28:32 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:32 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" returned: 0 in 0.541s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:32 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5 Apr 13 17:28:32 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:33 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b" returned: 0 in 0.462s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Lock "cinder-quobyte-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b" released by "delete_volume" :: held 1.092s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Created reservations ['1cd0010c-ae00-4bc4-b100-fd60af4ebed2', 'c1b47828-dabd-4b84-8ae4-ee9300e0d6e9', 'bea8ff2e-cae6-433c-ba87-0e7e846c0866', '3c5f69a1-76a3-4658-a9ca-c63a10c6086a'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:33 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.info" returned: 0 in 0.503s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:33 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.info is being set with open permissions: ugo+rw Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:33 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" returned: 0 in 0.497s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:33 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.info Apr 13 17:28:33 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-quobyte-3b3d77c3-c224-47c7-92d1-b811fe7c61f5" released by "delete_volume" :: held 1.100s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:33 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:28:33 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Created reservations ['0145bbed-dfcb-48ba-bd45-9c18c7a51f7e', '6e68227a-a840-47c9-b51f-65951011bd44', 'b51a6a66-e1c6-4f16-adcb-f4d0016a19c3', '721f1038-3d88-47ae-b7a7-d97964fe6ceb'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:33 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:28:33 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_service.periodic_task [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:33 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:28:33 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:33 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.info" returned: 0 in 0.437s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.117s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:33 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-53a894bc-62f1-4799-92d4-d0b712dcc600 tempest-VolumesSnapshotListTestJSON-602015423 None] Create snapshot completed successfully Apr 13 17:28:33 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.464s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:28:33 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Deleted volume successfully. Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f57fff24-149d-4a9f-93af-a242bd9c582d tempest-VolumesTransfersV357Test-1043966893 None] Lock "cinder-7e4a7fba-dc01-4e6b-8d37-e48cad9e970b-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:33 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.456s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:28:33 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Deleted volume successfully. Apr 13 17:28:33 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f94e726b-095a-45ac-a87a-6b33c055cea2 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-3b3d77c3-c224-47c7-92d1-b811fe7c61f5-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:34 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.462s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] Creating offline snapshot 864adff9-a08a-4bf0-bafd-d6a02e2786f8 of volume d36e219d-dc90-4716-a93d-0b0a90943268 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d61e11-9e71-4d3d-9d2f-a4494a3789bf]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "cinder-dd355067-6744-461c-9b5d-125f86afa4f6-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-dd355067-6744-461c-9b5d-125f86afa4f6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "cinder-quobyte-dd355067-6744-461c-9b5d-125f86afa4f6" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:34 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f Apr 13 17:28:34 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-quobyte-dd355067-6744-461c-9b5d-125f86afa4f6" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbd7f89-a2ec-48f8-8b17-14fa703a20dc]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:34 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6 Apr 13 17:28:34 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:34 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f" returned: 0 in 0.580s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d36e219d-dc90-4716-a93d-0b0a90943268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:35 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 1G Apr 13 17:28:35 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:35 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6" returned: 0 in 0.590s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:35 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6 Apr 13 17:28:35 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:35 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 1G" returned: 0 in 0.653s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:35 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-dd355067-6744-461c-9b5d-125f86afa4f6" returned: 0 in 0.550s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-quobyte-dd355067-6744-461c-9b5d-125f86afa4f6" released by "delete_volume" :: held 1.171s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:35 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 Apr 13 17:28:35 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Created reservations ['14aaafe1-1e2e-401c-828d-9ba2d36e1fe9', '22082b89-736b-4c0a-9e1c-ed3425c2b24d', '0aa29fb6-77d1-4e18-aa8c-2ed340af9e86', '729f9a07-a22a-4163-87ab-fc96fcb237bf'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:35 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:28:35 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:36 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8" returned: 0 in 0.563s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:36 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 is being set with open permissions: ugo+rw Apr 13 17:28:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:36 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 Apr 13 17:28:36 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:36 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.492s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:36 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:28:36 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Deleted volume successfully. Apr 13 17:28:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-67d76810-5dcd-47f6-942a-fb1adcda0218 tempest-SnapshotDependencyTests-1563336915 None] Lock "cinder-dd355067-6744-461c-9b5d-125f86afa4f6-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:36 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8" returned: 0 in 0.533s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:36 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-828be59a-7fe8-4d53-afb0-9d1361f54c36 tempest-VolumesSnapshotListTestJSON-602015423 None] Create snapshot completed successfully Apr 13 17:28:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] Creating offline snapshot 591086bf-77db-463f-b13d-b2c59698559c of volume d36e219d-dc90-4716-a93d-0b0a90943268 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:28:37 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c36cda-ec29-4498-ae57-05149f3903c9]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:37 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 Apr 13 17:28:37 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:38 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8" returned: 0 in 0.561s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d36e219d-dc90-4716-a93d-0b0a90943268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:28:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:38 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c 1G Apr 13 17:28:38 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:38 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c 1G" returned: 0 in 0.660s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:38 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c Apr 13 17:28:38 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:39 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c" returned: 0 in 0.490s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:39 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c is being set with open permissions: ugo+rw Apr 13 17:28:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:39 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c Apr 13 17:28:39 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:39 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c" returned: 0 in 0.503s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:39 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-50e03cf3-0723-40f4-ac6e-0529e265c3a3 tempest-VolumesSnapshotListTestJSON-602015423 None] Create snapshot completed successfully Apr 13 17:28:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "cinder-591086bf-77db-463f-b13d-b2c59698559c-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-591086bf-77db-463f-b13d-b2c59698559c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "cinder-quobyte-d36e219d-dc90-4716-a93d-0b0a90943268" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-d36e219d-dc90-4716-a93d-0b0a90943268" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "cinder-quobyte-591086bf-77db-463f-b13d-b2c59698559c" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-591086bf-77db-463f-b13d-b2c59698559c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Deleting offline snapshot 591086bf-77db-463f-b13d-b2c59698559c of volume d36e219d-dc90-4716-a93d-0b0a90943268 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:28:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] snapshot_file for this snap is: volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:28:41 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5dc335-9fa3-43b4-8b63-1ca0f012e1a7]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:41 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c Apr 13 17:28:41 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:42 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c" returned: 0 in 0.667s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d36e219d-dc90-4716-a93d-0b0a90943268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:28:42 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abfb6ba-4c54-4f09-8ac8-2b036eb738ae]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:42 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 Apr 13 17:28:42 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:42 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8" returned: 0 in 0.646s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d36e219d-dc90-4716-a93d-0b0a90943268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:28:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:42 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c Apr 13 17:28:42 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:43 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c" returned: 0 in 0.734s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:43 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c Apr 13 17:28:43 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:44 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.591086bf-77db-463f-b13d-b2c59698559c" returned: 0 in 0.513s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-591086bf-77db-463f-b13d-b2c59698559c" released by "_delete_snapshot" :: held 2.622s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-d36e219d-dc90-4716-a93d-0b0a90943268" released by "delete_snapshot" :: held 2.637s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Created reservations ['00cc49af-8eaf-45bc-b26d-dbd159c67cb5', 'dcbbd949-cccb-4c05-bbc2-e31f5e60c2b4', 'd110da5a-51d5-40de-95ba-2540de24ffc5', '664a61ed-5f76-42ec-9906-1e36a00f2190'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:44 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Delete snapshot completed successfully. Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-92eda66d-bd8b-4a8c-9c74-949692fa3aa4 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-591086bf-77db-463f-b13d-b2c59698559c-delete_snapshot" released by "delete_snapshot" :: held 2.793s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "cinder-864adff9-a08a-4bf0-bafd-d6a02e2786f8-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-864adff9-a08a-4bf0-bafd-d6a02e2786f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "cinder-quobyte-d36e219d-dc90-4716-a93d-0b0a90943268" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-d36e219d-dc90-4716-a93d-0b0a90943268" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "cinder-quobyte-864adff9-a08a-4bf0-bafd-d6a02e2786f8" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-864adff9-a08a-4bf0-bafd-d6a02e2786f8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Deleting offline snapshot 864adff9-a08a-4bf0-bafd-d6a02e2786f8 of volume d36e219d-dc90-4716-a93d-0b0a90943268 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] snapshot_file for this snap is: volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aa3592-cb9f-4032-bc37-6e6d5c999585]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:44 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 Apr 13 17:28:44 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Flow 'volume_create_manager' (f871652a-cb8f-46fd-9dee-81a8efec4098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9577f3-7fed-4972-99c1-3d7f812a9cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9577f3-7fed-4972-99c1-3d7f812a9cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-942827374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2885cc1-8cef-418b-b472-f0f22bedcfc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a0f98defa845578391c3cb40d25504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:45Z,use_quota=True,user_id='14a59ebe2bb843ee819e9b8adabeb237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5926c22f-bd3a-4a7f-90e9-141f2823d2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5926c22f-bd3a-4a7f-90e9-141f2823d2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7182c84-99db-4493-b494-b9525e645ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7182c84-99db-4493-b494-b9525e645ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2885cc1-8cef-418b-b472-f0f22bedcfc2', 'volume_name': 'volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c61d79-3502-40a0-be19-35e7d52de0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c61d79-3502-40a0-be19-35e7d52de0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3527ffca-35b3-44ff-af4b-19d09650ce54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:45 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Volume a2885cc1-8cef-418b-b472-f0f22bedcfc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2', 'volume_size': 1} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-942827374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2885cc1-8cef-418b-b472-f0f22bedcfc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a0f98defa845578391c3cb40d25504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:45Z,use_quota=True,user_id='14a59ebe2bb843ee819e9b8adabeb237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Creating volume a2885cc1-8cef-418b-b472-f0f22bedcfc2 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:28:45 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:45 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 1073741824 Apr 13 17:28:45 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:45 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8" returned: 0 in 0.636s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d36e219d-dc90-4716-a93d-0b0a90943268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8665493a-6642-4554-85a1-e9143739bdf2]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:45 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f Apr 13 17:28:45 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:45 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 1073741824" returned: 0 in 0.695s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:45 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 Apr 13 17:28:45 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:46 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f" returned: 0 in 0.624s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d36e219d-dc90-4716-a93d-0b0a90943268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:28:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:46 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 Apr 13 17:28:46 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:46 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2" returned: 0 in 0.560s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:28:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3527ffca-35b3-44ff-af4b-19d09650ce54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9fb4f7-d347-4805-8e8b-7a3a50e72f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:46 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Volume volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 (a2885cc1-8cef-418b-b472-f0f22bedcfc2): created successfully Apr 13 17:28:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9fb4f7-d347-4805-8e8b-7a3a50e72f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Flow 'volume_create_manager' (f871652a-cb8f-46fd-9dee-81a8efec4098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:46 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-40dee928-9edc-4429-9a08-c445443b16ad tempest-VolumesActionsTest-1269916325 None] Created volume successfully. Apr 13 17:28:46 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8" returned: 0 in 0.594s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:46 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8 Apr 13 17:28:46 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:47 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.864adff9-a08a-4bf0-bafd-d6a02e2786f8" returned: 0 in 0.624s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-864adff9-a08a-4bf0-bafd-d6a02e2786f8" released by "_delete_snapshot" :: held 2.543s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-d36e219d-dc90-4716-a93d-0b0a90943268" released by "delete_snapshot" :: held 2.557s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Created reservations ['b954ad1c-02d9-497e-9229-9d10d7d9e28e', '77e5b483-e53b-401b-be96-46fe401ee9f8', '1b6ba6a1-052d-4bc1-ab42-d4cb94d8d35c', 'c4f0b7b2-5667-48cc-9e2c-e97ab6327cc5'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:47 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Delete snapshot completed successfully. Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2fb7c6c3-64ed-40d0-ba8c-9238df2bcaef tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-864adff9-a08a-4bf0-bafd-d6a02e2786f8-delete_snapshot" released by "delete_snapshot" :: held 2.686s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "cinder-188da1f9-f3b4-47bd-b60b-33364a7cb15f-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-188da1f9-f3b4-47bd-b60b-33364a7cb15f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "cinder-quobyte-d36e219d-dc90-4716-a93d-0b0a90943268" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-d36e219d-dc90-4716-a93d-0b0a90943268" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "cinder-quobyte-188da1f9-f3b4-47bd-b60b-33364a7cb15f" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-188da1f9-f3b4-47bd-b60b-33364a7cb15f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Deleting offline snapshot 188da1f9-f3b4-47bd-b60b-33364a7cb15f of volume d36e219d-dc90-4716-a93d-0b0a90943268 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] snapshot_file for this snap is: volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[72380de5-496e-457a-99db-56612bbea605]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:48 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f Apr 13 17:28:48 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:48 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f" returned: 0 in 0.648s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d36e219d-dc90-4716-a93d-0b0a90943268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:28:48 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a28e63-b443-4ec5-a619-58a71255fc8a]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:48 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 Apr 13 17:28:48 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:49 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268" returned: 0 in 0.503s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:49 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f Apr 13 17:28:49 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:49 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f" returned: 0 in 0.473s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:49 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f Apr 13 17:28:49 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:50 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268.188da1f9-f3b4-47bd-b60b-33364a7cb15f" returned: 0 in 0.432s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:50 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=153,cinder:INSERT=47,cinder:UPDATE=170,cinder:DELETE=13 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:28:50 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:UPDATE=179,cinder:SELECT=125,cinder:DELETE=18,cinder:INSERT=51 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:28:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-188da1f9-f3b4-47bd-b60b-33364a7cb15f" released by "_delete_snapshot" :: held 2.139s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-d36e219d-dc90-4716-a93d-0b0a90943268" released by "delete_snapshot" :: held 2.164s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:50 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Created reservations ['27b2853c-6b33-4bd2-a644-5ee44003a5a1', 'ddf1bf50-a9bd-4f2a-b8f9-9bacbda1267b', '1a0202a2-b35d-41cf-9cf5-4ec29f4a3eba', '2db6d465-81d1-4fbc-b929-5789fbe90986'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:50 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Delete snapshot completed successfully. Apr 13 17:28:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-16eaa350-2319-4757-8e0a-d40c157d46ce tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-188da1f9-f3b4-47bd-b60b-33364a7cb15f-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "cinder-d36e219d-dc90-4716-a93d-0b0a90943268-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-d36e219d-dc90-4716-a93d-0b0a90943268-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "cinder-quobyte-d36e219d-dc90-4716-a93d-0b0a90943268" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:28:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-d36e219d-dc90-4716-a93d-0b0a90943268" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:28:51 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a65b6c-2219-413a-804a-09c1fbc5ad7a]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:28:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:51 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 Apr 13 17:28:51 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:51 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268" returned: 0 in 0.487s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:51 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268 Apr 13 17:28:51 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:52 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-d36e219d-dc90-4716-a93d-0b0a90943268" returned: 0 in 0.436s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-quobyte-d36e219d-dc90-4716-a93d-0b0a90943268" released by "delete_volume" :: held 0.959s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:52 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Created reservations ['ff9a5004-a310-497f-a159-a717d9f95e32', '308d8d2c-5f6f-441f-9b50-c3a93906fee5', 'e69afa71-f1f1-42cf-b0ac-9562f6e15cd6', '36fea6b3-a89e-43f8-b7e1-b0056936606b'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:28:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:52 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:28:52 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:52 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.527s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:52 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:28:52 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Deleted volume successfully. Apr 13 17:28:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0a45188b-4d41-43ee-b56e-bdfd028d41f3 tempest-VolumesSnapshotListTestJSON-602015423 None] Lock "cinder-d36e219d-dc90-4716-a93d-0b0a90943268-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Flow 'volume_create_manager' (eb83f908-1650-45e9-859d-bfbfd28288f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e22c7ce-0afc-4d38-8f86-0f5f73890512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e22c7ce-0afc-4d38-8f86-0f5f73890512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1590912340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc51a79e-be28-4b5a-abf9-4e8a456e7f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa107abe8a3043ffbd46deebe42cbb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:55Z,use_quota=True,user_id='da1b0b5e03c2475fad596cc93efbc5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80d58ec-eac8-4886-8376-09b00ee226d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80d58ec-eac8-4886-8376-09b00ee226d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86fc055-3a37-40a2-97bf-d7bad4d5c36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86fc055-3a37-40a2-97bf-d7bad4d5c36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc51a79e-be28-4b5a-abf9-4e8a456e7f9c', 'volume_name': 'volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0d00cb-72ec-4539-bdf6-e23641b030d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0d00cb-72ec-4539-bdf6-e23641b030d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda89cea-4682-403a-a78e-9c2efc163804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:55 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume cc51a79e-be28-4b5a-abf9-4e8a456e7f9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c', 'volume_size': 1} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1590912340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc51a79e-be28-4b5a-abf9-4e8a456e7f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa107abe8a3043ffbd46deebe42cbb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:55Z,use_quota=True,user_id='da1b0b5e03c2475fad596cc93efbc5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Creating volume cc51a79e-be28-4b5a-abf9-4e8a456e7f9c {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:28:55 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:55 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c 1073741824 Apr 13 17:28:55 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:55 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c 1073741824" returned: 0 in 0.513s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:55 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c Apr 13 17:28:55 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:56 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c" returned: 0 in 0.438s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:28:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda89cea-4682-403a-a78e-9c2efc163804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce17024-ec9c-49bb-b960-736036f946c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:56 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c (cc51a79e-be28-4b5a-abf9-4e8a456e7f9c): created successfully Apr 13 17:28:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce17024-ec9c-49bb-b960-736036f946c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Flow 'volume_create_manager' (eb83f908-1650-45e9-859d-bfbfd28288f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:56 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-fa276d53-819e-4eb8-a0db-13b446587dd8 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Created volume successfully. Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Flow 'volume_create_manager' (99b91fbd-556f-41f6-aa00-f240783e1066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398d478b-15dc-487e-99e6-26d495747c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398d478b-15dc-487e-99e6-26d495747c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-542758438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb7b312-6bca-48d6-9521-1b29bf18bf7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa107abe8a3043ffbd46deebe42cbb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:58Z,use_quota=True,user_id='da1b0b5e03c2475fad596cc93efbc5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a94a25d-76d1-4662-b6ba-c11fc502065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a94a25d-76d1-4662-b6ba-c11fc502065d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc26597-0dc9-4de9-93e9-da807119ac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc26597-0dc9-4de9-93e9-da807119ac24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cb7b312-6bca-48d6-9521-1b29bf18bf7a', 'volume_name': 'volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528da315-6621-4a7a-8eb0-d5e4f7b3416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528da315-6621-4a7a-8eb0-d5e4f7b3416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563c01e1-095c-4670-93a7-8838881b8ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:57 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume 8cb7b312-6bca-48d6-9521-1b29bf18bf7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a', 'volume_size': 1} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-542758438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb7b312-6bca-48d6-9521-1b29bf18bf7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa107abe8a3043ffbd46deebe42cbb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:58Z,use_quota=True,user_id='da1b0b5e03c2475fad596cc93efbc5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Creating volume 8cb7b312-6bca-48d6-9521-1b29bf18bf7a {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:28:57 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:57 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a 1073741824 Apr 13 17:28:57 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Flow 'volume_create_manager' (df79da50-e714-4957-9fec-40d36069a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8509a533-b311-47ca-b7bf-e41948b64ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8509a533-b311-47ca-b7bf-e41948b64ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-634854990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e648588-b818-4c3d-a4d5-346032074d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa107abe8a3043ffbd46deebe42cbb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:58Z,use_quota=True,user_id='da1b0b5e03c2475fad596cc93efbc5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784e8c1b-8d34-423d-b104-a360f913328b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784e8c1b-8d34-423d-b104-a360f913328b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843223d5-459c-4e9c-bc60-71b220ac89b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843223d5-459c-4e9c-bc60-71b220ac89b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e648588-b818-4c3d-a4d5-346032074d93', 'volume_name': 'volume-1e648588-b818-4c3d-a4d5-346032074d93', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03086961-c7fb-46f0-b3e6-f22fad5acbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03086961-c7fb-46f0-b3e6-f22fad5acbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218a47ca-960a-4b1e-b71b-ed8c89780be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:57 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume 1e648588-b818-4c3d-a4d5-346032074d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e648588-b818-4c3d-a4d5-346032074d93', 'volume_size': 1} Apr 13 17:28:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Flow 'volume_create_manager' (39c94bd9-af85-4640-b40e-cf1062e17bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd2888a-a4f8-4779-9a8d-6f68d1cfdf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd2888a-a4f8-4779-9a8d-6f68d1cfdf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-596035632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa5d966-59a2-4c27-a944-34373c0ba4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa107abe8a3043ffbd46deebe42cbb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:58Z,use_quota=True,user_id='da1b0b5e03c2475fad596cc93efbc5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b287a329-46ae-4649-b014-fed6a2bae975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b287a329-46ae-4649-b014-fed6a2bae975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f757da99-7dd9-4791-8135-a044f7818f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f757da99-7dd9-4791-8135-a044f7818f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa5d966-59a2-4c27-a944-34373c0ba4d5', 'volume_name': 'volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50296ca7-5ceb-4439-ae66-4929ce2fcc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50296ca7-5ceb-4439-ae66-4929ce2fcc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d95173-32ea-4b9b-abe8-faaa9b28a074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume 8aa5d966-59a2-4c27-a944-34373c0ba4d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5', 'volume_size': 1} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Flow 'volume_create_manager' (e2becdb5-f00c-49d0-aab7-f6b0f19cc4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f90798-698e-4d5f-a778-a163d3bfb348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f90798-698e-4d5f-a778-a163d3bfb348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1621490765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19874b79-c537-4cd7-bb2b-419edc129513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa107abe8a3043ffbd46deebe42cbb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:58Z,use_quota=True,user_id='da1b0b5e03c2475fad596cc93efbc5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:58 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c64e46-9d9d-4fb7-bb39-b7d8bc1d2a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c64e46-9d9d-4fb7-bb39-b7d8bc1d2a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca684ddd-a4f0-4784-b68f-405e5913d365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca684ddd-a4f0-4784-b68f-405e5913d365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19874b79-c537-4cd7-bb2b-419edc129513', 'volume_name': 'volume-19874b79-c537-4cd7-bb2b-419edc129513', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efdacd2-d9dd-4603-a473-41a1927bc40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efdacd2-d9dd-4603-a473-41a1927bc40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c801ac8-9a00-436a-8c07-96d6e1cb3721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume 19874b79-c537-4cd7-bb2b-419edc129513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19874b79-c537-4cd7-bb2b-419edc129513', 'volume_size': 1} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a 1073741824" returned: 0 in 0.644s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:58 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a Apr 13 17:28:58 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Flow 'volume_create_manager' (88a038ea-7e1d-4ee1-ac08-91b62d7a238a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84a4670-39a8-46e3-b449-d891af07888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84a4670-39a8-46e3-b449-d891af07888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1149928182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fafbd33e-4b55-4f2b-a0ff-1fd7124689b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa107abe8a3043ffbd46deebe42cbb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:59Z,use_quota=True,user_id='da1b0b5e03c2475fad596cc93efbc5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7404a55a-0ca7-4618-a70d-9bb21cc85ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7404a55a-0ca7-4618-a70d-9bb21cc85ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9270cb84-2843-4a35-830a-176819c19414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9270cb84-2843-4a35-830a-176819c19414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fafbd33e-4b55-4f2b-a0ff-1fd7124689b5', 'volume_name': 'volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b41391-cade-40f6-88e8-4a43024eed59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b41391-cade-40f6-88e8-4a43024eed59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b962adc-8ae8-4391-8723-e4bbafed9091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:58 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume fafbd33e-4b55-4f2b-a0ff-1fd7124689b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5', 'volume_size': 1} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:58 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a" returned: 0 in 0.535s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.989s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-634854990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e648588-b818-4c3d-a4d5-346032074d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa107abe8a3043ffbd46deebe42cbb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:58Z,use_quota=True,user_id='da1b0b5e03c2475fad596cc93efbc5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Creating volume 1e648588-b818-4c3d-a4d5-346032074d93 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:28:58 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e648588-b818-4c3d-a4d5-346032074d93 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:58 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563c01e1-095c-4670-93a7-8838881b8ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e8c115-59cf-4781-8423-c6e5dc9837c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:28:59 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a (8cb7b312-6bca-48d6-9521-1b29bf18bf7a): created successfully Apr 13 17:28:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e8c115-59cf-4781-8423-c6e5dc9837c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:28:59 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e648588-b818-4c3d-a4d5-346032074d93 1073741824 Apr 13 17:28:59 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:28:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Flow 'volume_create_manager' (99b91fbd-556f-41f6-aa00-f240783e1066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:28:59 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-34eca8b0-4c2d-4df0-a30b-69efcc0c8e37 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Created volume successfully. Apr 13 17:28:59 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Apr 13 17:28:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e648588-b818-4c3d-a4d5-346032074d93 1073741824" returned: 0 in 0.721s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:28:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e648588-b818-4c3d-a4d5-346032074d93 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:28:59 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e648588-b818-4c3d-a4d5-346032074d93 Apr 13 17:28:59 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:00 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e648588-b818-4c3d-a4d5-346032074d93" returned: 0 in 0.464s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.030s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-596035632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa5d966-59a2-4c27-a944-34373c0ba4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa107abe8a3043ffbd46deebe42cbb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:58Z,use_quota=True,user_id='da1b0b5e03c2475fad596cc93efbc5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Creating volume 8aa5d966-59a2-4c27-a944-34373c0ba4d5 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:29:00 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218a47ca-960a-4b1e-b71b-ed8c89780be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e648588-b818-4c3d-a4d5-346032074d93', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:00 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5 1073741824 Apr 13 17:29:00 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821e0254-5178-4fef-b575-23bff2f9afb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:00 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume volume-1e648588-b818-4c3d-a4d5-346032074d93 (1e648588-b818-4c3d-a4d5-346032074d93): created successfully Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821e0254-5178-4fef-b575-23bff2f9afb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Flow 'volume_create_manager' (df79da50-e714-4957-9fec-40d36069a83d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:29:00 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-30e9d26e-1402-4b09-9bb6-38ea6d47a1f6 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Created volume successfully. Apr 13 17:29:00 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5 1073741824" returned: 0 in 0.585s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:00 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5 Apr 13 17:29:00 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:01 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5" returned: 0 in 0.460s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.864s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1621490765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19874b79-c537-4cd7-bb2b-419edc129513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa107abe8a3043ffbd46deebe42cbb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:58Z,use_quota=True,user_id='da1b0b5e03c2475fad596cc93efbc5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Creating volume 19874b79-c537-4cd7-bb2b-419edc129513 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:29:01 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-19874b79-c537-4cd7-bb2b-419edc129513 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d95173-32ea-4b9b-abe8-faaa9b28a074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f657262f-c7b7-4661-85ae-8e520026a584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:01 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-19874b79-c537-4cd7-bb2b-419edc129513 1073741824 Apr 13 17:29:01 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:01 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5 (8aa5d966-59a2-4c27-a944-34373c0ba4d5): created successfully Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f657262f-c7b7-4661-85ae-8e520026a584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Flow 'volume_create_manager' (39c94bd9-af85-4640-b40e-cf1062e17bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:29:01 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-68030650-c072-438b-ac51-84a4f97f7e8e tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Created volume successfully. Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9ace2a80-f78a-4572-af9e-a1b281e219ee tempest-VolumesActionsTest-1269916325 None] Acquiring lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2" by "attach_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9ace2a80-f78a-4572-af9e-a1b281e219ee tempest-VolumesActionsTest-1269916325 None] Lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2" acquired by "attach_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:01 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-9ace2a80-f78a-4572-af9e-a1b281e219ee tempest-VolumesActionsTest-1269916325 None] Attaching volume a2885cc1-8cef-418b-b472-f0f22bedcfc2 to instance 4883d327-7b87-4423-9bdd-493e05ac63d7 at mountpoint /dev/vdb on host None. Apr 13 17:29:01 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-9ace2a80-f78a-4572-af9e-a1b281e219ee tempest-VolumesActionsTest-1269916325 None] Attach volume completed successfully. Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9ace2a80-f78a-4572-af9e-a1b281e219ee tempest-VolumesActionsTest-1269916325 None] Lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2" released by "attach_volume" :: held 0.071s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:01 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-19874b79-c537-4cd7-bb2b-419edc129513 1073741824" returned: 0 in 0.564s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-19874b79-c537-4cd7-bb2b-419edc129513 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:01 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-19874b79-c537-4cd7-bb2b-419edc129513 Apr 13 17:29:01 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ab3b84c4-e352-4333-b5a1-a3f08550da73 tempest-VolumesActionsTest-1269916325 None] Acquiring lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2-detach_volume" by "detach_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ab3b84c4-e352-4333-b5a1-a3f08550da73 tempest-VolumesActionsTest-1269916325 None] Lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ab3b84c4-e352-4333-b5a1-a3f08550da73 tempest-VolumesActionsTest-1269916325 None] Detaching volume a2885cc1-8cef-418b-b472-f0f22bedcfc2 from instance 4883d327-7b87-4423-9bdd-493e05ac63d7. Apr 13 17:29:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ab3b84c4-e352-4333-b5a1-a3f08550da73 tempest-VolumesActionsTest-1269916325 None] Detach volume completed successfully. Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-ab3b84c4-e352-4333-b5a1-a3f08550da73 tempest-VolumesActionsTest-1269916325 None] Lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:02 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-19874b79-c537-4cd7-bb2b-419edc129513" returned: 0 in 0.489s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.710s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1149928182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fafbd33e-4b55-4f2b-a0ff-1fd7124689b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa107abe8a3043ffbd46deebe42cbb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:28:59Z,use_quota=True,user_id='da1b0b5e03c2475fad596cc93efbc5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Creating volume fafbd33e-4b55-4f2b-a0ff-1fd7124689b5 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:29:02 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c801ac8-9a00-436a-8c07-96d6e1cb3721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19874b79-c537-4cd7-bb2b-419edc129513', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f4a15c-8ed3-4a2c-af3a-03abe9107155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:02 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5 1073741824 Apr 13 17:29:02 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:02 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume volume-19874b79-c537-4cd7-bb2b-419edc129513 (19874b79-c537-4cd7-bb2b-419edc129513): created successfully Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f4a15c-8ed3-4a2c-af3a-03abe9107155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Flow 'volume_create_manager' (e2becdb5-f00c-49d0-aab7-f6b0f19cc4d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:29:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-02cd372a-6cc4-4cd1-9a79-384c4058d2f4 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Created volume successfully. Apr 13 17:29:02 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5 1073741824" returned: 0 in 0.596s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:03 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5 Apr 13 17:29:03 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:03 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5" returned: 0 in 0.436s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:29:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b962adc-8ae8-4391-8723-e4bbafed9091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e35cb4-66ed-406d-8fcb-fa73112ae7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:03 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Volume volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5 (fafbd33e-4b55-4f2b-a0ff-1fd7124689b5): created successfully Apr 13 17:29:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e35cb4-66ed-406d-8fcb-fa73112ae7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Flow 'volume_create_manager' (88a038ea-7e1d-4ee1-ac08-91b62d7a238a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:29:03 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-eb7257f0-8cf6-4cb5-90c8-f02c71a87123 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Created volume successfully. Apr 13 17:29:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "cinder-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "cinder-quobyte-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-quobyte-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5" acquired by "delete_volume" :: waited 0.016s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:04 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3936db-09ba-40e2-824c-66b267efbe04]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:04 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5 Apr 13 17:29:04 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:04 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5" returned: 0 in 0.531s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:04 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5 Apr 13 17:29:04 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:05 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5" returned: 0 in 0.422s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-quobyte-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5" released by "delete_volume" :: held 0.976s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:05 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Created reservations ['a6b93a5d-8986-4423-b05d-67f3a5bff5c9', 'a08518f1-e29c-4b0b-97e0-7528809444a2', '7fb27a63-bed0-4a5b-8521-aaba1ac80ee4', 'd1ed63f0-9fde-4ad2-a55f-165ec4864911'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:29:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:05 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:29:05 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:05 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.483s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:05 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:29:05 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Deleted volume successfully. Apr 13 17:29:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-69dfd9e4-e1ce-495e-8313-db528bc967c5 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-fafbd33e-4b55-4f2b-a0ff-1fd7124689b5-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:06 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "cinder-19874b79-c537-4cd7-bb2b-419edc129513-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:06 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-19874b79-c537-4cd7-bb2b-419edc129513-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:06 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "cinder-quobyte-19874b79-c537-4cd7-bb2b-419edc129513" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:06 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-quobyte-19874b79-c537-4cd7-bb2b-419edc129513" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:06 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[67945791-29db-4c55-ab36-9b68b354e84f]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-19874b79-c537-4cd7-bb2b-419edc129513 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:06 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-19874b79-c537-4cd7-bb2b-419edc129513 Apr 13 17:29:06 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:06 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-19874b79-c537-4cd7-bb2b-419edc129513" returned: 0 in 0.544s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-19874b79-c537-4cd7-bb2b-419edc129513 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:06 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-19874b79-c537-4cd7-bb2b-419edc129513 Apr 13 17:29:06 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:07 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-19874b79-c537-4cd7-bb2b-419edc129513" returned: 0 in 0.444s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:07 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-quobyte-19874b79-c537-4cd7-bb2b-419edc129513" released by "delete_volume" :: held 1.025s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:07 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Created reservations ['588421e4-ac75-4856-a292-ce04d96d7ad6', '3349bfd2-8fce-4a24-96d8-00cf07cd1956', 'ce3adb17-b91a-4909-a020-0afe9b604fdc', 'c6daee3c-672f-49e7-ad52-4728227077d5'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:29:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:07 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:29:07 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:07 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.443s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:07 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:29:07 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Deleted volume successfully. Apr 13 17:29:07 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f97e595a-3b83-46d3-9578-3d61b68f5502 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-19874b79-c537-4cd7-bb2b-419edc129513-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "cinder-8aa5d966-59a2-4c27-a944-34373c0ba4d5-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-8aa5d966-59a2-4c27-a944-34373c0ba4d5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "cinder-quobyte-8aa5d966-59a2-4c27-a944-34373c0ba4d5" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-quobyte-8aa5d966-59a2-4c27-a944-34373c0ba4d5" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:08 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[78da19ab-5149-47cb-8cb5-bbc16861dbd6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:08 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5 Apr 13 17:29:08 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:09 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5" returned: 0 in 0.510s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:09 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5 Apr 13 17:29:09 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:09 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8aa5d966-59a2-4c27-a944-34373c0ba4d5" returned: 0 in 0.497s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:09 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-quobyte-8aa5d966-59a2-4c27-a944-34373c0ba4d5" released by "delete_volume" :: held 1.029s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:09 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Created reservations ['5075d711-3489-4d1f-933f-21c6c40e2ea3', 'd2bb5d25-b994-4ac1-883b-bfaf9913c4cc', '6f31e164-e101-49be-aa94-6348dc9e2427', '0ae8db8d-2096-4dd7-a20c-8136843f3138'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:29:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:09 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:29:09 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:10 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.458s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:10 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:29:10 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Deleted volume successfully. Apr 13 17:29:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c97b6299-2723-46a1-94b7-827a0b24d53d tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-8aa5d966-59a2-4c27-a944-34373c0ba4d5-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "cinder-1e648588-b818-4c3d-a4d5-346032074d93-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-1e648588-b818-4c3d-a4d5-346032074d93-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "cinder-quobyte-1e648588-b818-4c3d-a4d5-346032074d93" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-quobyte-1e648588-b818-4c3d-a4d5-346032074d93" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:10 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c353940-0a3f-4c1d-b90f-22fab11e5a81]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e648588-b818-4c3d-a4d5-346032074d93 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:10 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e648588-b818-4c3d-a4d5-346032074d93 Apr 13 17:29:10 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:11 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e648588-b818-4c3d-a4d5-346032074d93" returned: 0 in 0.498s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e648588-b818-4c3d-a4d5-346032074d93 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:11 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e648588-b818-4c3d-a4d5-346032074d93 Apr 13 17:29:11 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:11 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1e648588-b818-4c3d-a4d5-346032074d93" returned: 0 in 0.440s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-quobyte-1e648588-b818-4c3d-a4d5-346032074d93" released by "delete_volume" :: held 0.967s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Created reservations ['8d6d4188-955c-4e74-8b7d-af60dabdfa54', '3cee2275-99f4-45cd-9e7c-50dcc7418a33', 'cac640f7-b2a9-4f76-9269-959f3a2a3417', '7c7ec594-d67b-461a-8298-f32bf4a7a5c3'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:11 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:29:11 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "cinder-8cb7b312-6bca-48d6-9521-1b29bf18bf7a-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-8cb7b312-6bca-48d6-9521-1b29bf18bf7a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "cinder-quobyte-8cb7b312-6bca-48d6-9521-1b29bf18bf7a" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-quobyte-8cb7b312-6bca-48d6-9521-1b29bf18bf7a" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[660e7f49-7d73-43d1-86d9-09e5bd2ee3b8]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:11 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a Apr 13 17:29:11 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:12 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.512s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:29:12 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Deleted volume successfully. Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-68b804ad-cd48-4929-9576-d6599efe1e24 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-1e648588-b818-4c3d-a4d5-346032074d93-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:12 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a" returned: 0 in 0.532s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:12 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a Apr 13 17:29:12 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:12 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8cb7b312-6bca-48d6-9521-1b29bf18bf7a" returned: 0 in 0.423s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-quobyte-8cb7b312-6bca-48d6-9521-1b29bf18bf7a" released by "delete_volume" :: held 0.983s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Created reservations ['be63860e-8466-423e-b960-f0dec4fba848', '60e06e87-0086-4dc0-a631-2d18d094f27d', '5ad4c1ee-924b-42f3-a8b3-151033bd72ca', '59b21ea8-6951-419e-b2a4-78c640856fd6'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:13 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:29:13 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:13 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.418s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:13 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:29:13 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Deleted volume successfully. Apr 13 17:29:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-78756b7a-87b0-42e0-aae4-3268eb38c339 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-8cb7b312-6bca-48d6-9521-1b29bf18bf7a-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "cinder-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "cinder-quobyte-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-quobyte-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c" acquired by "delete_volume" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:14 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e7f2b3-009c-4601-8dd1-f55b869a7af7]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:14 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c Apr 13 17:29:14 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:14 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c" returned: 0 in 0.586s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:14 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c Apr 13 17:29:14 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:15 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c" returned: 0 in 0.474s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:15 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-quobyte-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c" released by "delete_volume" :: held 1.087s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:15 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Created reservations ['fb3563e4-d13a-4f7b-9647-2d07a54ad1f1', '90f0925c-b8b7-49fd-b0a1-941e7d71a04a', '66aac9cb-9fee-45c8-b2a6-36796d848398', '3d2401d9-87c9-4e64-9b3a-31eca7683777'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:29:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:15 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:29:15 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:15 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.483s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:15 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:29:15 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Deleted volume successfully. Apr 13 17:29:15 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2b9271d2-fdfc-4be4-abb5-b2f998611f98 tempest-CreateVolumesFromSourceVolumeTest-1717772509 None] Lock "cinder-cc51a79e-be28-4b5a-abf9-4e8a456e7f9c-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Flow 'volume_create_manager' (6b03b4a7-917f-4b4a-af59-6a06663f127d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdf33a7-3cb9-4173-bb4f-6f20077bd69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdf33a7-3cb9-4173-bb4f-6f20077bd69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be172b50-7403-43b5-9a22-839f17dd95aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596fa4ecd08452492b543322a759816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:29:18Z,use_quota=True,user_id='e1a417dbc07145f6a3822b6d4af15479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a01d2ee-d59d-4108-be63-9f9258610793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a01d2ee-d59d-4108-be63-9f9258610793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e171c4f-da3b-4433-a275-e7bb36fb5ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e171c4f-da3b-4433-a275-e7bb36fb5ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be172b50-7403-43b5-9a22-839f17dd95aa', 'volume_name': 'volume-be172b50-7403-43b5-9a22-839f17dd95aa', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0f3dc1-f331-4306-9085-41bdfcab4595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0f3dc1-f331-4306-9085-41bdfcab4595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8dcfa7-24a6-450f-8606-4c0b0c5d6b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:18 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Volume be172b50-7403-43b5-9a22-839f17dd95aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be172b50-7403-43b5-9a22-839f17dd95aa', 'volume_size': 1} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be172b50-7403-43b5-9a22-839f17dd95aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596fa4ecd08452492b543322a759816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:29:18Z,use_quota=True,user_id='e1a417dbc07145f6a3822b6d4af15479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Creating volume be172b50-7403-43b5-9a22-839f17dd95aa {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:29:18 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-be172b50-7403-43b5-9a22-839f17dd95aa 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:18 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-be172b50-7403-43b5-9a22-839f17dd95aa 1073741824 Apr 13 17:29:18 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:18 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-be172b50-7403-43b5-9a22-839f17dd95aa 1073741824" returned: 0 in 0.484s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-be172b50-7403-43b5-9a22-839f17dd95aa {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:18 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-be172b50-7403-43b5-9a22-839f17dd95aa Apr 13 17:29:18 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:19 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-be172b50-7403-43b5-9a22-839f17dd95aa" returned: 0 in 0.468s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:29:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8dcfa7-24a6-450f-8606-4c0b0c5d6b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be172b50-7403-43b5-9a22-839f17dd95aa', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29c26f2-c87c-465a-83b7-5aae453c3ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:19 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Volume volume-be172b50-7403-43b5-9a22-839f17dd95aa (be172b50-7403-43b5-9a22-839f17dd95aa): created successfully Apr 13 17:29:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29c26f2-c87c-465a-83b7-5aae453c3ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Flow 'volume_create_manager' (6b03b4a7-917f-4b4a-af59-6a06663f127d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:29:19 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d7acca6b-e1f3-40ec-aa1f-c5ac30498e16 tempest-CinderUnicodeTest-368164657 None] Created volume successfully. Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Flow 'volume_create_manager' (9777a7cf-993c-4ad6-a50c-a50a79cd0dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c651e6b-f03e-441e-971b-97fc128a9640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c651e6b-f03e-441e-971b-97fc128a9640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:29:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-914621442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596fa4ecd08452492b543322a759816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:29:20Z,use_quota=True,user_id='e1a417dbc07145f6a3822b6d4af15479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c740f0d-ebd1-4e4e-a9ff-a4a0ee80916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c740f0d-ebd1-4e4e-a9ff-a4a0ee80916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb0fb8c-5d13-4291-82cf-2476edc4283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb0fb8c-5d13-4291-82cf-2476edc4283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29', 'volume_name': 'volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb01eb7-7c2d-40b0-b20b-ebdcd4eaf5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb01eb7-7c2d-40b0-b20b-ebdcd4eaf5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a52781-7865-43bf-9229-6b17c1fc838e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:20 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Volume 5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29', 'volume_size': 1} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:29:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-914621442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596fa4ecd08452492b543322a759816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:29:20Z,use_quota=True,user_id='e1a417dbc07145f6a3822b6d4af15479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Creating volume 5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:29:20 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:29:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:20 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 1073741824 Apr 13 17:29:20 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:21 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 1073741824" returned: 0 in 0.647s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:21 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 Apr 13 17:29:21 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:21 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29" returned: 0 in 0.447s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:29:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a52781-7865-43bf-9229-6b17c1fc838e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fa06c5-6993-4f26-9c6a-7a13149f1739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:21 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Volume volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 (5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29): created successfully Apr 13 17:29:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fa06c5-6993-4f26-9c6a-7a13149f1739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Flow 'volume_create_manager' (9777a7cf-993c-4ad6-a50c-a50a79cd0dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:29:21 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-808c8070-7a74-4b81-9c49-b5e2e15b1b81 tempest-CinderUnicodeTest-368164657 None] Created volume successfully. Apr 13 17:29:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-caa36de4-d143-45c1-b086-28d2cabac204 tempest-VolumesActionsTest-1269916325 None] Acquiring lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2" by "attach_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-caa36de4-d143-45c1-b086-28d2cabac204 tempest-VolumesActionsTest-1269916325 None] Lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2" acquired by "attach_volume" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:22 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-caa36de4-d143-45c1-b086-28d2cabac204 tempest-VolumesActionsTest-1269916325 None] Attaching volume a2885cc1-8cef-418b-b472-f0f22bedcfc2 to instance 5c1dcfeb-3a6a-4792-a666-813663b83148 at mountpoint /dev/vdb on host None. Apr 13 17:29:22 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-caa36de4-d143-45c1-b086-28d2cabac204 tempest-VolumesActionsTest-1269916325 None] Attach volume completed successfully. Apr 13 17:29:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-caa36de4-d143-45c1-b086-28d2cabac204 tempest-VolumesActionsTest-1269916325 None] Lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2" released by "attach_volume" :: held 0.075s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] Creating offline snapshot f812bacd-1d94-4533-991a-87605f75bd0d of volume 5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:29:22 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff35af7-ef32-4caa-976c-766d38e177a2]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:22 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 Apr 13 17:29:22 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-52ee685b-fda6-4cd8-8321-42db0477290f tempest-VolumesActionsTest-1269916325 None] Acquiring lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2-detach_volume" by "detach_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-52ee685b-fda6-4cd8-8321-42db0477290f tempest-VolumesActionsTest-1269916325 None] Lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:23 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-52ee685b-fda6-4cd8-8321-42db0477290f tempest-VolumesActionsTest-1269916325 None] Detaching volume a2885cc1-8cef-418b-b472-f0f22bedcfc2 from instance 5c1dcfeb-3a6a-4792-a666-813663b83148. Apr 13 17:29:23 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-52ee685b-fda6-4cd8-8321-42db0477290f tempest-VolumesActionsTest-1269916325 None] Detach volume completed successfully. Apr 13 17:29:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-52ee685b-fda6-4cd8-8321-42db0477290f tempest-VolumesActionsTest-1269916325 None] Lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:23 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29" returned: 0 in 0.517s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:23 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d 1G Apr 13 17:29:23 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:23 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d 1G" returned: 0 in 0.591s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:24 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d Apr 13 17:29:24 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:24 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d" returned: 0 in 0.445s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:24 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d is being set with open permissions: ugo+rw Apr 13 17:29:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:24 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d Apr 13 17:29:24 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:24 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d" returned: 0 in 0.428s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:24 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.info Apr 13 17:29:24 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:25 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.info" returned: 0 in 0.555s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:25 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.info is being set with open permissions: ugo+rw Apr 13 17:29:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:25 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.info Apr 13 17:29:25 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:25 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.info" returned: 0 in 0.438s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.035s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:25 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-4b3f6aae-3e3b-45fa-a9d8-37003c0f28a6 tempest-CinderUnicodeTest-368164657 None] Create snapshot completed successfully Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Acquiring lock "cinder-f812bacd-1d94-4533-991a-87605f75bd0d-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Lock "cinder-f812bacd-1d94-4533-991a-87605f75bd0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Acquiring lock "cinder-quobyte-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Lock "cinder-quobyte-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Acquiring lock "cinder-quobyte-f812bacd-1d94-4533-991a-87605f75bd0d" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Lock "cinder-quobyte-f812bacd-1d94-4533-991a-87605f75bd0d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Deleting offline snapshot f812bacd-1d94-4533-991a-87605f75bd0d of volume 5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] snapshot_file for this snap is: volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f90e08-7455-4626-9bd8-e504ca1f9b9e]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:27 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d Apr 13 17:29:27 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:27 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d" returned: 0 in 0.518s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[25077882-7c5f-4841-a9ec-d36c540aa9f3]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:27 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 Apr 13 17:29:27 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:28 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29" returned: 0 in 0.500s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:28 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d Apr 13 17:29:28 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:28 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d" returned: 0 in 0.457s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:28 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d Apr 13 17:29:28 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:29 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29.f812bacd-1d94-4533-991a-87605f75bd0d" returned: 0 in 0.451s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Lock "cinder-quobyte-f812bacd-1d94-4533-991a-87605f75bd0d" released by "_delete_snapshot" :: held 1.988s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Lock "cinder-quobyte-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29" released by "delete_snapshot" :: held 2.004s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:29 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Created reservations ['47eaaf4d-f2e5-4d85-9e81-33cc23ae1ef9', '169904e8-0036-40a6-bd91-3929a8ca6224', 'e070b38c-e71d-47cf-9284-0a9e4ea00a9e', 'a3064ae2-56cf-44bc-94ab-2919522196ea'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:29:29 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Delete snapshot completed successfully. Apr 13 17:29:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6c60d13-cbc9-4ed7-8b14-8ad0efcd03ae tempest-CinderUnicodeTest-368164657 None] Lock "cinder-f812bacd-1d94-4533-991a-87605f75bd0d-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Acquiring lock "cinder-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Lock "cinder-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Acquiring lock "cinder-quobyte-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Lock "cinder-quobyte-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:30 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a1af61-fbd9-4d1a-9b76-93c2104c72a8]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:30 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 Apr 13 17:29:30 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:30 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29" returned: 0 in 0.567s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:30 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29 Apr 13 17:29:30 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5537b832-ac70-4135-a902-20160c34043a]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:31 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29" returned: 0 in 0.478s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Lock "cinder-quobyte-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29" released by "delete_volume" :: held 1.105s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:31 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 Apr 13 17:29:31 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Created reservations ['4b5750e0-a560-45fb-9728-9ee3268a1d71', 'c61d500c-e969-41b3-b56a-f941cc4df114', '0a726336-b88e-4fd0-af84-9a4028be4f5d', '8720fe66-6c49-444c-b514-292a5bb24c0e'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:31 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:29:31 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:31 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2" returned: 0 in 0.496s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aee85b-36a6-479c-966c-1ea113b8fb6f]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:31 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.408s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:29:31 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Deleted volume successfully. Apr 13 17:29:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e27c2a4a-8dc2-41d0-8099-a1942b40491c tempest-CinderUnicodeTest-368164657 None] Lock "cinder-5e8b5bff-1f74-48de-bd52-2e4d3a9f9f29-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:31 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 Apr 13 17:29:31 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:32 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2" returned: 0 in 0.477s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.3fa548b2-a0cb-4e58-a6e0-299bf4192fa52rknmp91.img {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:32 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.3fa548b2-a0cb-4e58-a6e0-299bf4192fa52rknmp91.img Apr 13 17:29:32 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Acquiring lock "cinder-be172b50-7403-43b5-9a22-839f17dd95aa-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Lock "cinder-be172b50-7403-43b5-9a22-839f17dd95aa-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Acquiring lock "cinder-quobyte-be172b50-7403-43b5-9a22-839f17dd95aa" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Lock "cinder-quobyte-be172b50-7403-43b5-9a22-839f17dd95aa" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[172538a7-4526-47f6-9e88-1d7c734894dd]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-be172b50-7403-43b5-9a22-839f17dd95aa {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:32 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-be172b50-7403-43b5-9a22-839f17dd95aa Apr 13 17:29:32 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:33 devstack cinder-volume[81998]: DEBUG oslo_service.periodic_task [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:29:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:33 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:29:33 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:34 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-be172b50-7403-43b5-9a22-839f17dd95aa" returned: 0 in 1.559s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-be172b50-7403-43b5-9a22-839f17dd95aa {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:34 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-be172b50-7403-43b5-9a22-839f17dd95aa Apr 13 17:29:34 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:34 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.3fa548b2-a0cb-4e58-a6e0-299bf4192fa52rknmp91.img" returned: 0 in 2.210s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d471098-2de6-432e-ba90-75489c986acc]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:34 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 Apr 13 17:29:34 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:34 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.961s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:29:34 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-be172b50-7403-43b5-9a22-839f17dd95aa" returned: 0 in 0.698s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Lock "cinder-quobyte-be172b50-7403-43b5-9a22-839f17dd95aa" released by "delete_volume" :: held 2.290s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Created reservations ['c68d3f72-36a0-450c-91cf-7602e6fa6ed1', '7de1806b-13be-4690-9ee5-aecf6d1115fa', '76696e40-4d55-471d-919b-8e790fdec706', '5dfb30d0-eb8d-4a49-b037-2edc14f25e81'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:34 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:29:34 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:35 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2" returned: 0 in 0.653s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:35 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.3fa548b2-a0cb-4e58-a6e0-299bf4192fa52rknmp91.img {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:29:35 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] Converted 1024.00 MB image at 462.99 MB/s Apr 13 17:29:35 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] 3fa548b2-a0cb-4e58-a6e0-299bf4192fa5 was raw, no need to convert to raw {{(pid=81998) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 13 17:29:35 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.481s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:35 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:29:35 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Deleted volume successfully. Apr 13 17:29:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-9ac0ac56-f373-47ae-9009-fe027aed5cb0 tempest-CinderUnicodeTest-368164657 None] Lock "cinder-be172b50-7403-43b5-9a22-839f17dd95aa-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.879s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:45 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] Uploaded volume to glance image-id: 3fa548b2-a0cb-4e58-a6e0-299bf4192fa5. {{(pid=81998) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 13 17:29:45 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=85,cinder:INSERT=23,cinder:UPDATE=108,cinder:DELETE=12 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:29:45 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-baf6cf3b-f0fb-47ac-bd9b-b4b08a4f0771 tempest-VolumesActionsTest-1269916325 None] Copy volume to image completed successfully. Apr 13 17:29:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:46 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[026114e2-9135-45db-b9ba-5a1937450857]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:46 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 Apr 13 17:29:46 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:46 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2" returned: 0 in 0.500s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:46 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b4a9b7-40f5-4cb7-9135-1e10c9ae30c6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:46 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 Apr 13 17:29:46 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:47 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2" returned: 0 in 0.496s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:47 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img Apr 13 17:29:47 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:49 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img" returned: 0 in 1.877s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:49 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bfe29d-2983-46b9-87e2-2d699bfd50b9]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:49 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 Apr 13 17:29:49 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:49 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2" returned: 0 in 0.612s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:49 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2, size 1024.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:29:49 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Converted 1024.00 MB image at 545.08 MB/s Apr 13 17:29:49 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6 was raw, converting to qcow2 {{(pid=81998) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 13 17:29:49 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b87b5f-3bbc-4c60-8f47-cee6620bcc87]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:49 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img Apr 13 17:29:49 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:50 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img" returned: 0 in 0.512s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:50 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img Apr 13 17:29:50 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:50 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img" returned: 1 in 0.472s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:29:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img /opt/stack/data/cinder/conversion/vol_upload_g2dfsvgd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:50 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img /opt/stack/data/cinder/conversion/vol_upload_g2dfsvgd Apr 13 17:29:50 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:51 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img /opt/stack/data/cinder/conversion/vol_upload_g2dfsvgd" returned: 0 in 1.036s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:51 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Image conversion details: src /opt/stack/data/cinder/conversion/a2885cc1-8cef-418b-b472-f0f22bedcfc2.temp_image.a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6n4iolrup.img, size 1024.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/conversion/vol_upload_g2dfsvgd {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:29:51 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Converted 1024.00 MB image at 987.46 MB/s Apr 13 17:29:51 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee73ef3b-3720-4ff5-b704-58f3d6568706]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g2dfsvgd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:51 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g2dfsvgd Apr 13 17:29:51 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:52 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g2dfsvgd" returned: 0 in 0.454s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.808s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:53 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Uploaded volume to glance image-id: a8ba7cd6-6db8-4fd3-9ce8-1d65390b99f6. {{(pid=81998) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 13 17:29:53 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=96,cinder:INSERT=34,cinder:UPDATE=123,cinder:DELETE=6 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:29:53 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-09e37ef9-59c8-45e4-a4ea-cbca3e385b7f tempest-VolumesActionsTest-1269916325 None] Copy volume to image completed successfully. Apr 13 17:29:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Acquiring lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Acquiring lock "cinder-quobyte-a2885cc1-8cef-418b-b472-f0f22bedcfc2" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:29:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Lock "cinder-quobyte-a2885cc1-8cef-418b-b472-f0f22bedcfc2" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:29:54 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[53258bbf-8900-469a-8ae4-f7755e5a5dae]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:29:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:54 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 Apr 13 17:29:54 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:54 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2" returned: 0 in 0.490s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:54 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2 Apr 13 17:29:54 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:54 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-a2885cc1-8cef-418b-b472-f0f22bedcfc2" returned: 0 in 0.405s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Lock "cinder-quobyte-a2885cc1-8cef-418b-b472-f0f22bedcfc2" released by "delete_volume" :: held 0.924s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:55 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Created reservations ['d0896780-d352-4366-aadd-204b2fb77649', 'b33eda56-e3d5-48c8-9674-915c069940a8', 'bedbf67f-56c7-4f90-8f65-5cd7ef05183d', '96cfe0a3-a0c5-4f7d-bd6e-91362c8caecf'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:29:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:55 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:29:55 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:55 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.520s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:55 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:29:55 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Deleted volume successfully. Apr 13 17:29:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-45c1081a-3584-49ed-8860-de0fafb0032d tempest-VolumesActionsTest-1269916325 None] Lock "cinder-a2885cc1-8cef-418b-b472-f0f22bedcfc2-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (5622fea7-0ded-4856-8ae8-356d21efd40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0ffef6-bbee-4c09-82d2-3c0b35f5742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0ffef6-bbee-4c09-82d2-3c0b35f5742b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-435327653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f16bbd3-a840-428d-a782-bae228d5a48c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:29:59Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c5d542-470c-4e0d-876b-2439d6edd47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c5d542-470c-4e0d-876b-2439d6edd47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a90e9a-d2c6-41d9-bd1e-4b7771adc2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a90e9a-d2c6-41d9-bd1e-4b7771adc2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f16bbd3-a840-428d-a782-bae228d5a48c', 'volume_name': 'volume-5f16bbd3-a840-428d-a782-bae228d5a48c', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83e99df-3195-43dc-a42c-7e61800293d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83e99df-3195-43dc-a42c-7e61800293d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3897564-1b00-4f4b-ad27-1456cfae2b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:29:59 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Volume 5f16bbd3-a840-428d-a782-bae228d5a48c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f16bbd3-a840-428d-a782-bae228d5a48c', 'volume_size': 1} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-435327653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f16bbd3-a840-428d-a782-bae228d5a48c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:29:59Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Creating volume 5f16bbd3-a840-428d-a782-bae228d5a48c {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:29:59 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5f16bbd3-a840-428d-a782-bae228d5a48c 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:59 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5f16bbd3-a840-428d-a782-bae228d5a48c 1073741824 Apr 13 17:29:59 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:29:59 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5f16bbd3-a840-428d-a782-bae228d5a48c 1073741824" returned: 0 in 0.511s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:29:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5f16bbd3-a840-428d-a782-bae228d5a48c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:29:59 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5f16bbd3-a840-428d-a782-bae228d5a48c Apr 13 17:29:59 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:00 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5f16bbd3-a840-428d-a782-bae228d5a48c" returned: 0 in 0.417s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:00 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:30:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3897564-1b00-4f4b-ad27-1456cfae2b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f16bbd3-a840-428d-a782-bae228d5a48c', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a06a42-c720-4c6e-85df-d81c11b6ff0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:00 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Volume volume-5f16bbd3-a840-428d-a782-bae228d5a48c (5f16bbd3-a840-428d-a782-bae228d5a48c): created successfully Apr 13 17:30:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a06a42-c720-4c6e-85df-d81c11b6ff0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:00 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (5622fea7-0ded-4856-8ae8-356d21efd40a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:00 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-3aedd084-0ee4-4a75-96b8-3c3a5823b3a7 tempest-VolumesGetTest-1779941661 None] Created volume successfully. Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (1b0eabd9-7143-4db0-b0d0-de2e1f21eff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c36671-caa5-49ff-841e-2ceb0c2d10d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c36671-caa5-49ff-841e-2ceb0c2d10d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-845395237',display_name='tempest-VolumesGetTest-Volume-707536865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe41bdd6-8a66-4337-bdb7-04df9f64dec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:02Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10004e6-15a1-4ead-8760-32039047aedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10004e6-15a1-4ead-8760-32039047aedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d71cff-871e-48ff-97d5-1f2d6fcc288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d71cff-871e-48ff-97d5-1f2d6fcc288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe41bdd6-8a66-4337-bdb7-04df9f64dec6', 'volume_name': 'volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a585b8b-0137-4897-bb79-b95e2c05116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a585b8b-0137-4897-bb79-b95e2c05116d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b2c5d0-f62c-42c2-b003-80625cd897fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:01 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Volume fe41bdd6-8a66-4337-bdb7-04df9f64dec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6', 'volume_size': 1} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-845395237',display_name='tempest-VolumesGetTest-Volume-707536865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe41bdd6-8a66-4337-bdb7-04df9f64dec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:02Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Creating volume fe41bdd6-8a66-4337-bdb7-04df9f64dec6 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:30:01 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:30:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:01 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6 1073741824 Apr 13 17:30:01 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:02 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6 1073741824" returned: 0 in 0.464s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:02 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6 Apr 13 17:30:02 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:02 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6" returned: 0 in 0.427s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:30:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b2c5d0-f62c-42c2-b003-80625cd897fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be09c6c0-7dae-4b53-9591-f6d6c75aab7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:02 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Volume volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6 (fe41bdd6-8a66-4337-bdb7-04df9f64dec6): created successfully Apr 13 17:30:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be09c6c0-7dae-4b53-9591-f6d6c75aab7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (1b0eabd9-7143-4db0-b0d0-de2e1f21eff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f7508b99-f6f7-4196-bb2b-31438b122fbf tempest-VolumesGetTest-1779941661 None] Created volume successfully. Apr 13 17:30:03 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-fe41bdd6-8a66-4337-bdb7-04df9f64dec6-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:03 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Lock "cinder-fe41bdd6-8a66-4337-bdb7-04df9f64dec6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-quobyte-fe41bdd6-8a66-4337-bdb7-04df9f64dec6" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-fe41bdd6-8a66-4337-bdb7-04df9f64dec6" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:04 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[db74800f-19bd-4cf8-9200-937ba53970a0]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:04 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6 Apr 13 17:30:04 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:04 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6" returned: 0 in 0.484s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:04 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6 Apr 13 17:30:04 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:04 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fe41bdd6-8a66-4337-bdb7-04df9f64dec6" returned: 0 in 0.414s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-fe41bdd6-8a66-4337-bdb7-04df9f64dec6" released by "delete_volume" :: held 0.924s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:04 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Created reservations ['dae3828b-92b9-44e5-8712-8fc55e89242f', '5490ad2c-5848-4a29-8f9a-1a4f394aef14', '4692f65a-353a-4f15-920b-070c0c37991b', '62acba9d-4e39-48bd-aa9a-bcdadafbd4bf'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:05 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:30:05 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-5f16bbd3-a840-428d-a782-bae228d5a48c-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Lock "cinder-5f16bbd3-a840-428d-a782-bae228d5a48c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-quobyte-5f16bbd3-a840-428d-a782-bae228d5a48c" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-5f16bbd3-a840-428d-a782-bae228d5a48c" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e2e70a-a824-4da4-9d05-23a8befd63fc]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5f16bbd3-a840-428d-a782-bae228d5a48c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:05 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5f16bbd3-a840-428d-a782-bae228d5a48c Apr 13 17:30:05 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:05 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.500s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:30:05 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Deleted volume successfully. Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-e5af3e92-425b-4cb9-8805-afecffa89427 tempest-VolumesGetTest-1779941661 None] Lock "cinder-fe41bdd6-8a66-4337-bdb7-04df9f64dec6-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:05 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5f16bbd3-a840-428d-a782-bae228d5a48c" returned: 0 in 0.491s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5f16bbd3-a840-428d-a782-bae228d5a48c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:05 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5f16bbd3-a840-428d-a782-bae228d5a48c Apr 13 17:30:05 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:06 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-5f16bbd3-a840-428d-a782-bae228d5a48c" returned: 0 in 0.408s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-5f16bbd3-a840-428d-a782-bae228d5a48c" released by "delete_volume" :: held 0.930s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Created reservations ['86d6d0c6-37e7-4974-a55e-d41a225dcf37', '7e17fc30-16c9-4d3c-a828-c9e07a4199c9', '3df4fffb-7ae1-4321-930f-a2a17c858012', 'cf2e2dd6-2665-42e2-9639-33e5dbdfaf07'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:06 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:30:06 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (7c7df7fe-50d9-4e1c-a057-a467f5694436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc171e4d-65c5-4fbb-980f-e73287e9f5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc171e4d-65c5-4fbb-980f-e73287e9f5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-638438855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6d81da-7f61-4cf7-8b1f-95721fa8ff18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:06Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35804735-af32-4a07-9e9a-64d6d28f9907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35804735-af32-4a07-9e9a-64d6d28f9907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d535d657-125e-479d-a0de-d7b1b7b9a9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d535d657-125e-479d-a0de-d7b1b7b9a9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f6d81da-7f61-4cf7-8b1f-95721fa8ff18', 'volume_name': 'volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17467143-9309-425b-95fb-8e0184e0544b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17467143-9309-425b-95fb-8e0184e0544b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e44a36-70fd-4f31-b773-3f9d62bcdda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:06 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Volume 9f6d81da-7f61-4cf7-8b1f-95721fa8ff18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18', 'volume_size': 1} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-638438855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6d81da-7f61-4cf7-8b1f-95721fa8ff18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:06Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Creating volume 9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:30:06 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:06 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 1073741824 Apr 13 17:30:06 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:06 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.468s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:30:06 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Deleted volume successfully. Apr 13 17:30:06 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0899acb6-2997-43ad-b5d5-505e776b7009 tempest-VolumesGetTest-1779941661 None] Lock "cinder-5f16bbd3-a840-428d-a782-bae228d5a48c-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:07 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 1073741824" returned: 0 in 0.504s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:07 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 Apr 13 17:30:07 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:07 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18" returned: 0 in 0.432s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:30:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e44a36-70fd-4f31-b773-3f9d62bcdda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e37a8f-2b7b-436a-a4b7-df861280d488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:07 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Volume volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 (9f6d81da-7f61-4cf7-8b1f-95721fa8ff18): created successfully Apr 13 17:30:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e37a8f-2b7b-436a-a4b7-df861280d488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (7c7df7fe-50d9-4e1c-a057-a467f5694436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:07 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b3232896-0bc0-47a6-83cd-ec8e19c1ceba tempest-VolumesGetTest-1779941661 None] Created volume successfully. Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (876e651f-9152-443e-a0db-473e30496471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800ad1f4-ef84-4c63-aed2-6595b91699c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800ad1f4-ef84-4c63-aed2-6595b91699c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2040888473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9784c252-8064-4b5f-b453-ccf31848e496,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9f6d81da-7f61-4cf7-8b1f-95721fa8ff18,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:09Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e12ce0d-0e76-4dff-a01f-6babb556c124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e12ce0d-0e76-4dff-a01f-6babb556c124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57ae1d8-9a04-4c69-b336-301b0b68e8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57ae1d8-9a04-4c69-b336-301b0b68e8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9784c252-8064-4b5f-b453-ccf31848e496', 'volume_name': 'volume-9784c252-8064-4b5f-b453-ccf31848e496', 'volume_size': 1, 'source_volid': '9f6d81da-7f61-4cf7-8b1f-95721fa8ff18', 'source_volstatus': 'available'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f37264-673e-4b84-af34-4646b8d0ebff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f37264-673e-4b84-af34-4646b8d0ebff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46d76fe-48ec-4848-98fb-89bbaa035eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:08 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Volume 9784c252-8064-4b5f-b453-ccf31848e496: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9784c252-8064-4b5f-b453-ccf31848e496', 'volume_size': 1, 'source_volid': '9f6d81da-7f61-4cf7-8b1f-95721fa8ff18', 'source_volstatus': 'available'} Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:08 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Cloning volume 9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 to volume 9784c252-8064-4b5f-b453-ccf31848e496 Apr 13 17:30:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Creating offline snapshot 37a1687f-0864-4f58-bb4e-1188f6cc5bbd of volume 9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:30:09 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5e45b5-6b2e-4955-91d5-ab14f89a5464]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:09 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 Apr 13 17:30:09 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:09 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18" returned: 0 in 0.519s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:09 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd 1G Apr 13 17:30:09 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:10 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd 1G" returned: 0 in 0.488s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:10 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd Apr 13 17:30:10 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:10 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd" returned: 0 in 0.429s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:10 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd is being set with open permissions: ugo+rw Apr 13 17:30:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:10 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd Apr 13 17:30:10 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:10 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd" returned: 0 in 0.425s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:10 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.info Apr 13 17:30:10 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:11 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.info" returned: 0 in 0.441s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:11 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.info is being set with open permissions: ugo+rw Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:11 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.info Apr 13 17:30:11 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:11 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.info" returned: 0 in 0.427s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-quobyte-9784c252-8064-4b5f-b453-ccf31848e496" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-9784c252-8064-4b5f-b453-ccf31848e496" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] snapshot: 37a1687f-0864-4f58-bb4e-1188f6cc5bbd, volume: 9784c252-8064-4b5f-b453-ccf31848e496, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a580e03f-d560-4f4e-bda8-f206dd81156f]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:11 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd Apr 13 17:30:11 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:12 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd" returned: 0 in 0.498s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:30:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:30:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:30:12 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5d955c-1fb4-4b25-bda9-4c32c04d5c13]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:12 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 Apr 13 17:30:12 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:12 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18" returned: 0 in 0.487s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:12 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496 not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:30:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:12 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496 Apr 13 17:30:12 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:14 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496" returned: 0 in 1.927s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:14 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[32151e66-541b-4e7f-ab66-07db945cc713]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:14 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 Apr 13 17:30:14 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:15 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18" returned: 0 in 0.607s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:15 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496 {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:30:15 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Converted 1024.00 MB image at 530.97 MB/s Apr 13 17:30:15 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496 is being set with open permissions: ugo+rw Apr 13 17:30:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:15 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496 Apr 13 17:30:15 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:15 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496" returned: 0 in 0.414s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:15 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-9784c252-8064-4b5f-b453-ccf31848e496" released by "_copy_volume_from_snapshot" :: held 3.977s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:15 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-quobyte-37a1687f-0864-4f58-bb4e-1188f6cc5bbd" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:15 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-37a1687f-0864-4f58-bb4e-1188f6cc5bbd" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Deleting offline snapshot 37a1687f-0864-4f58-bb4e-1188f6cc5bbd of volume 9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:30:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] snapshot_file for this snap is: volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:30:15 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c482ea-39f1-4eba-a5b5-0cfe100375b0]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:15 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd Apr 13 17:30:15 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:16 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd" returned: 0 in 0.476s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:30:16 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e93148-83d9-4b91-b1e1-52e364921fbe]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:16 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 Apr 13 17:30:16 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:16 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18" returned: 0 in 0.476s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:16 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd Apr 13 17:30:16 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:17 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd" returned: 0 in 0.448s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:17 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd Apr 13 17:30:17 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:17 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18.37a1687f-0864-4f58-bb4e-1188f6cc5bbd" returned: 0 in 0.415s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:17 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-37a1687f-0864-4f58-bb4e-1188f6cc5bbd" released by "_delete_snapshot" :: held 1.859s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.683s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46d76fe-48ec-4848-98fb-89bbaa035eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9784c252-8064-4b5f-b453-ccf31848e496', 'volume_size': 1, 'source_volid': '9f6d81da-7f61-4cf7-8b1f-95721fa8ff18', 'source_volstatus': 'available'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ebe02b-e68b-4d89-a13b-b8849b9feace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:17 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Volume volume-9784c252-8064-4b5f-b453-ccf31848e496 (9784c252-8064-4b5f-b453-ccf31848e496): created successfully Apr 13 17:30:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ebe02b-e68b-4d89-a13b-b8849b9feace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (876e651f-9152-443e-a0db-473e30496471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:17 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f54ed428-d45f-46be-a63c-ef05ddbd3f96 tempest-VolumesGetTest-1779941661 None] Created volume successfully. Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (35c3fcd8-134a-4ce5-b468-64ffed48cfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5687571-ccb6-40b0-a50a-f16e893d46b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5687571-ccb6-40b0-a50a-f16e893d46b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-340370754',display_name='tempest-VolumesGetTest-Volume-1425243648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588b23b9-8d5e-4171-9769-969993b2259c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:19Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44a17c5-b90c-4fdd-baeb-eeda409a4764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44a17c5-b90c-4fdd-baeb-eeda409a4764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfe330b-b8b6-407a-99fb-0a047145a04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfe330b-b8b6-407a-99fb-0a047145a04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '588b23b9-8d5e-4171-9769-969993b2259c', 'volume_name': 'volume-588b23b9-8d5e-4171-9769-969993b2259c', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4283558-a286-4062-8676-e348f62edfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4283558-a286-4062-8676-e348f62edfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cbe7ac-e191-40c5-81a9-fbf173ed31f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:19 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Volume 588b23b9-8d5e-4171-9769-969993b2259c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-588b23b9-8d5e-4171-9769-969993b2259c', 'volume_size': 1} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-340370754',display_name='tempest-VolumesGetTest-Volume-1425243648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588b23b9-8d5e-4171-9769-969993b2259c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:19Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Creating volume 588b23b9-8d5e-4171-9769-969993b2259c {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:30:19 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-588b23b9-8d5e-4171-9769-969993b2259c 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:19 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-588b23b9-8d5e-4171-9769-969993b2259c 1073741824 Apr 13 17:30:19 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:19 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-588b23b9-8d5e-4171-9769-969993b2259c 1073741824" returned: 0 in 0.478s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-588b23b9-8d5e-4171-9769-969993b2259c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:19 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-588b23b9-8d5e-4171-9769-969993b2259c Apr 13 17:30:19 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:20 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-588b23b9-8d5e-4171-9769-969993b2259c" returned: 0 in 0.436s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:20 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:30:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cbe7ac-e191-40c5-81a9-fbf173ed31f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-588b23b9-8d5e-4171-9769-969993b2259c', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebcfc5e-a461-45ee-abc4-e2120cb03b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:20 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Volume volume-588b23b9-8d5e-4171-9769-969993b2259c (588b23b9-8d5e-4171-9769-969993b2259c): created successfully Apr 13 17:30:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebcfc5e-a461-45ee-abc4-e2120cb03b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:20 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (35c3fcd8-134a-4ce5-b468-64ffed48cfaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:20 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-9ee0e27f-f67f-4bd3-807c-cb966528bde2 tempest-VolumesGetTest-1779941661 None] Created volume successfully. Apr 13 17:30:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-588b23b9-8d5e-4171-9769-969993b2259c-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Lock "cinder-588b23b9-8d5e-4171-9769-969993b2259c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-quobyte-588b23b9-8d5e-4171-9769-969993b2259c" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-588b23b9-8d5e-4171-9769-969993b2259c" acquired by "delete_volume" :: waited 0.007s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:21 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf6c6cd-667a-4b68-bdff-f47dc3e31e5e]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-588b23b9-8d5e-4171-9769-969993b2259c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:21 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-588b23b9-8d5e-4171-9769-969993b2259c Apr 13 17:30:21 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:21 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-588b23b9-8d5e-4171-9769-969993b2259c" returned: 0 in 0.483s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-588b23b9-8d5e-4171-9769-969993b2259c {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:21 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-588b23b9-8d5e-4171-9769-969993b2259c Apr 13 17:30:21 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:22 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-588b23b9-8d5e-4171-9769-969993b2259c" returned: 0 in 0.431s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-588b23b9-8d5e-4171-9769-969993b2259c" released by "delete_volume" :: held 0.940s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Created reservations ['34ac1270-caff-4446-89ea-1b631b7dd4a0', '078f01e1-89b7-4487-97a4-d77ca1942239', 'ee52cd87-b654-45ae-b174-c2482b4b16c0', 'df5e793d-98f6-4380-9589-b28340ab5c04'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:22 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:30:22 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-9784c252-8064-4b5f-b453-ccf31848e496-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Lock "cinder-9784c252-8064-4b5f-b453-ccf31848e496-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-quobyte-9784c252-8064-4b5f-b453-ccf31848e496" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-9784c252-8064-4b5f-b453-ccf31848e496" acquired by "delete_volume" :: waited 0.007s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca091150-16c1-4215-a312-070ccefe5de4]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:22 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496 Apr 13 17:30:22 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:22 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.449s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:30:22 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Deleted volume successfully. Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-32e4b6bc-db2d-433d-b40c-be06b80ae0e9 tempest-VolumesGetTest-1779941661 None] Lock "cinder-588b23b9-8d5e-4171-9769-969993b2259c-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:22 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496" returned: 0 in 0.484s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:22 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496 Apr 13 17:30:22 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:23 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9784c252-8064-4b5f-b453-ccf31848e496" returned: 0 in 0.437s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-9784c252-8064-4b5f-b453-ccf31848e496" released by "delete_volume" :: held 0.943s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Created reservations ['5d40c44a-20d0-4496-baa4-dc4ab5caa78f', 'bb280fb7-164b-4843-a47d-71456be70b34', 'd581f4fc-3aa4-4477-a1d1-b3273694089b', '6bb64c6a-d615-4ae4-b101-860ae68c6d3e'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:23 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:30:23 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Lock "cinder-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-quobyte-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30fd289-42d5-4f99-a9a3-b62cfae47e48]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:23 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 Apr 13 17:30:23 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:23 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.480s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:30:23 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Deleted volume successfully. Apr 13 17:30:23 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-2d1f793c-19a9-4de8-94bd-53b834436edf tempest-VolumesGetTest-1779941661 None] Lock "cinder-9784c252-8064-4b5f-b453-ccf31848e496-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:24 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18" returned: 0 in 0.504s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:24 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18 Apr 13 17:30:24 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:24 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18" returned: 0 in 0.421s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18" released by "delete_volume" :: held 0.968s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:24 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Created reservations ['68de823d-135b-47c9-9da0-0fa3e68f35c0', '96a6b5a7-39de-4b83-b04b-439191c4e647', '8b6bd4c8-cdc4-4411-a3aa-13a7be54afce', 'f84b34f0-d5ce-43e4-872b-0914880acf4a'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:30:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:24 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:30:24 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (f8b77145-0619-4244-bcb4-071ccb61635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b168e18-c9f4-4a0f-93a2-0f7e0a7dd200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b168e18-c9f4-4a0f-93a2-0f7e0a7dd200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1060436547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1567a480-803d-4f09-8607-288b8089f223,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:25Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139427fb-7716-4bfc-839c-713b66eb226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139427fb-7716-4bfc-839c-713b66eb226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c0d686-1e23-4e0b-a849-f0008642693d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.image.glance [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Creating Keystone auth plugin from conf {{(pid=81998) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 17:30:25 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.470s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:30:25 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Deleted volume successfully. Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c05ca0a9-24ed-4fcc-9b43-26701ff6813e tempest-VolumesGetTest-1779941661 None] Lock "cinder-9f6d81da-7f61-4cf7-8b1f-95721fa8ff18-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c0d686-1e23-4e0b-a849-f0008642693d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1567a480-803d-4f09-8607-288b8089f223', 'volume_name': 'volume-1567a480-803d-4f09-8607-288b8089f223', 'volume_size': 1, 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afd653b3e1644792a661ae2b4015619a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'created_at': datetime.datetime(2026, 4, 13, 15, 17, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/696022cb-dcc0-451a-9908-378fc3a9d5ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556530ec-053c-4c3e-899e-9a46e113832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556530ec-053c-4c3e-899e-9a46e113832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64bed56-42ad-40ce-a731-1958fe2ea764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:25 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Volume 1567a480-803d-4f09-8607-288b8089f223: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1567a480-803d-4f09-8607-288b8089f223', 'volume_size': 1, 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afd653b3e1644792a661ae2b4015619a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'created_at': datetime.datetime(2026, 4, 13, 15, 17, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/696022cb-dcc0-451a-9908-378fc3a9d5ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Trying to clone 1567a480-803d-4f09-8607-288b8089f223 from image 696022cb-dcc0-451a-9908-378fc3a9d5ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]). {{(pid=81998) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81998) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 17:30:25 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Image download 20.69 MB at 20.69 MB/s Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0331c8d0-6ea4-4cfe-ac85-0e27e059a50a]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:25 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD Apr 13 17:30:25 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:26 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Temporary image 696022cb-dcc0-451a-9908-378fc3a9d5ca is fetched for user e82625400fd64231826e7a5736d48736. {{(pid=81998) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2580e3fd-9498-4a6c-8bc1-cdb39db27588]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:26 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD Apr 13 17:30:26 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:26 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1060436547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1567a480-803d-4f09-8607-288b8089f223,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:25Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Creating volume 1567a480-803d-4f09-8607-288b8089f223 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:30:26 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:30:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:26 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 1073741824 Apr 13 17:30:26 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:27 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 1073741824" returned: 0 in 0.500s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:27 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 Apr 13 17:30:27 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:27 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223" returned: 0 in 0.434s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:27 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:30:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:27 devstack cinder-volume[81998]: DEBUG cinder.volume.volume_utils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Attempting download of 696022cb-dcc0-451a-9908-378fc3a9d5ca ((None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}])) to volume 1567a480-803d-4f09-8607-288b8089f223. {{(pid=81998) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 17:30:27 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a54496-4a0a-4695-9b45-38c62a920fc6]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_rlsqq751 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:27 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_rlsqq751 Apr 13 17:30:27 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:28 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_rlsqq751" returned: 0 in 0.476s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_rlsqq751 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:28 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_rlsqq751 Apr 13 17:30:28 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:28 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_rlsqq751" returned: 1 in 0.481s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_696022cb-dcc0-451a-9908-378fc3a9d5ca_rlsqq751' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:30:28 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a61fd02-3598-44db-a639-267e61db3ce1]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:28 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD Apr 13 17:30:28 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:29 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:29 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] 696022cb-dcc0-451a-9908-378fc3a9d5ca was qcow2, converting to raw {{(pid=81998) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 17:30:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:29 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 Apr 13 17:30:29 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:29 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223" returned: 0 in 0.821s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:29 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_696022cb-dcc0-451a-9908-378fc3a9d5ca_83h4onvtdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:30:29 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Converted 112.00 MB image at 112.00 MB/s Apr 13 17:30:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:29 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 1G Apr 13 17:30:29 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:30 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 1G" returned: 0 in 0.459s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:30 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1d16d0-0119-4120-add8-7c46827254a7]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:30 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 Apr 13 17:30:30 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:30 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223" returned: 0 in 0.473s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:30 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 Apr 13 17:30:30 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:31 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223" returned: 1 in 0.534s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:30:31 devstack cinder-volume[81998]: DEBUG cinder.volume.volume_utils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Downloaded image 696022cb-dcc0-451a-9908-378fc3a9d5ca ((None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}])) to volume 1567a480-803d-4f09-8607-288b8089f223 successfully. {{(pid=81998) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 17:30:31 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Temporary image 696022cb-dcc0-451a-9908-378fc3a9d5ca for user e82625400fd64231826e7a5736d48736 is deleted. {{(pid=81998) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 17:30:31 devstack cinder-volume[81998]: DEBUG cinder.volume.volume_utils [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Marking volume 1567a480-803d-4f09-8607-288b8089f223 as bootable. {{(pid=81998) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 17:30:31 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Copying metadata from image 696022cb-dcc0-451a-9908-378fc3a9d5ca to 1567a480-803d-4f09-8607-288b8089f223. {{(pid=81998) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 17:30:31 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Creating volume glance metadata for volume 1567a480-803d-4f09-8607-288b8089f223 backed by image 696022cb-dcc0-451a-9908-378fc3a9d5ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81998) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 17:30:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64bed56-42ad-40ce-a731-1958fe2ea764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1567a480-803d-4f09-8607-288b8089f223', 'volume_size': 1, 'image_id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/696022cb-dcc0-451a-9908-378fc3a9d5ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afd653b3e1644792a661ae2b4015619a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '696022cb-dcc0-451a-9908-378fc3a9d5ca', 'created_at': datetime.datetime(2026, 4, 13, 15, 17, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/696022cb-dcc0-451a-9908-378fc3a9d5ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2644d250-081e-4b55-9456-20f606470a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:31 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Volume volume-1567a480-803d-4f09-8607-288b8089f223 (1567a480-803d-4f09-8607-288b8089f223): created successfully Apr 13 17:30:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2644d250-081e-4b55-9456-20f606470a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (f8b77145-0619-4244-bcb4-071ccb61635a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:31 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b2542c89-b1d6-456e-95cb-b432208a52b0 tempest-VolumesGetTest-1779941661 None] Created volume successfully. Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (e0b50528-42ba-416e-9c36-301743aa16d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d6986a-7538-43f1-8683-98f419214da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d6986a-7538-43f1-8683-98f419214da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-646609863',display_name='tempest-VolumesGetTest-Volume-67419278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3411483d-77bb-4e02-b0ef-832fb73dab10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:33Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c8d3c0-de1d-40b0-b0c3-ae8b6dc1da24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c8d3c0-de1d-40b0-b0c3-ae8b6dc1da24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0a42d8-4b07-4ed5-8dc1-388aac69b4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0a42d8-4b07-4ed5-8dc1-388aac69b4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3411483d-77bb-4e02-b0ef-832fb73dab10', 'volume_name': 'volume-3411483d-77bb-4e02-b0ef-832fb73dab10', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd2eff1-a1b3-463d-90e0-787d9f967ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd2eff1-a1b3-463d-90e0-787d9f967ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e266a9b1-a66f-49b8-a0db-e67e00f0b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:32 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Volume 3411483d-77bb-4e02-b0ef-832fb73dab10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3411483d-77bb-4e02-b0ef-832fb73dab10', 'volume_size': 1} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-646609863',display_name='tempest-VolumesGetTest-Volume-67419278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3411483d-77bb-4e02-b0ef-832fb73dab10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84de46a262fa434197a881e0f829f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:33Z,use_quota=True,user_id='e82625400fd64231826e7a5736d48736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Creating volume 3411483d-77bb-4e02-b0ef-832fb73dab10 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:30:32 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:30:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3411483d-77bb-4e02-b0ef-832fb73dab10 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:33 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3411483d-77bb-4e02-b0ef-832fb73dab10 1073741824 Apr 13 17:30:33 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:33 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3411483d-77bb-4e02-b0ef-832fb73dab10 1073741824" returned: 0 in 0.520s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3411483d-77bb-4e02-b0ef-832fb73dab10 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:33 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3411483d-77bb-4e02-b0ef-832fb73dab10 Apr 13 17:30:33 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG oslo_service.periodic_task [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:33 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:30:33 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:33 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3411483d-77bb-4e02-b0ef-832fb73dab10" returned: 0 in 0.424s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e266a9b1-a66f-49b8-a0db-e67e00f0b17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3411483d-77bb-4e02-b0ef-832fb73dab10', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eafe9f8-ce7e-4288-b304-5439135ed837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:33 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Volume volume-3411483d-77bb-4e02-b0ef-832fb73dab10 (3411483d-77bb-4e02-b0ef-832fb73dab10): created successfully Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eafe9f8-ce7e-4288-b304-5439135ed837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:33 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Flow 'volume_create_manager' (e0b50528-42ba-416e-9c36-301743aa16d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:33 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-27e80cbf-e7b5-4961-8fb1-521a61d3861a tempest-VolumesGetTest-1779941661 None] Created volume successfully. Apr 13 17:30:34 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.457s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:30:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-3411483d-77bb-4e02-b0ef-832fb73dab10-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Lock "cinder-3411483d-77bb-4e02-b0ef-832fb73dab10-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-quobyte-3411483d-77bb-4e02-b0ef-832fb73dab10" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-3411483d-77bb-4e02-b0ef-832fb73dab10" acquired by "delete_volume" :: waited 0.007s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:35 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[667ae94b-3158-4079-8fbb-95c7bca2d1f8]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3411483d-77bb-4e02-b0ef-832fb73dab10 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:35 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3411483d-77bb-4e02-b0ef-832fb73dab10 Apr 13 17:30:35 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:35 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3411483d-77bb-4e02-b0ef-832fb73dab10" returned: 0 in 0.508s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3411483d-77bb-4e02-b0ef-832fb73dab10 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:35 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3411483d-77bb-4e02-b0ef-832fb73dab10 Apr 13 17:30:35 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:36 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-3411483d-77bb-4e02-b0ef-832fb73dab10" returned: 0 in 0.447s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-3411483d-77bb-4e02-b0ef-832fb73dab10" released by "delete_volume" :: held 0.986s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:36 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Created reservations ['6a3a2fde-d9a6-4283-acdd-233db5e450a4', '210e6450-5e8c-450b-ae41-27a2b15d2948', 'f9372edb-78b7-444a-86bd-aa4e76e4a254', '395ebf9c-cf03-4deb-a3f1-b219dc63e0cd'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:30:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:36 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:30:36 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:36 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.423s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:36 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:30:36 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Deleted volume successfully. Apr 13 17:30:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-81d186a1-744e-465f-bf08-b4ce2f9c78b8 tempest-VolumesGetTest-1779941661 None] Lock "cinder-3411483d-77bb-4e02-b0ef-832fb73dab10-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-1567a480-803d-4f09-8607-288b8089f223-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Lock "cinder-1567a480-803d-4f09-8607-288b8089f223-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Acquiring lock "cinder-quobyte-1567a480-803d-4f09-8607-288b8089f223" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:37 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-1567a480-803d-4f09-8607-288b8089f223" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:37 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eb0a21-7b3f-4151-943e-248a9d1f044a]: (4, 'raw') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:37 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 Apr 13 17:30:37 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:37 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223" returned: 0 in 0.488s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:38 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 Apr 13 17:30:38 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:38 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223" returned: 1 in 0.486s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223' failed. Not Retrying. {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:30:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:38 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223 Apr 13 17:30:38 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:38 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1567a480-803d-4f09-8607-288b8089f223" returned: 0 in 0.472s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:38 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Lock "cinder-quobyte-1567a480-803d-4f09-8607-288b8089f223" released by "delete_volume" :: held 1.489s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:38 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Created reservations ['d409038d-ca04-426c-bdb4-c24f264ed2f8', 'f0834e37-9593-4401-9de3-521f8a6854cd', '079be287-756c-4216-9034-3f052c5d9fea', '540ba5db-b9c5-4250-8ffd-39d2364602b5'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:30:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:39 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:39 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:39 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:30:39 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:39 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.418s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:39 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:30:39 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Deleted volume successfully. Apr 13 17:30:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0fc6cd62-686d-4b25-b5f7-45582fe4137c tempest-VolumesGetTest-1779941661 None] Lock "cinder-1567a480-803d-4f09-8607-288b8089f223-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Flow 'volume_create_manager' (bb75e50e-786a-46eb-8bfa-137a1f87a752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3088118e-3018-4e1c-985e-c02fd3b22c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3088118e-3018-4e1c-985e-c02fd3b22c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-924577056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6544fd48-999a-4077-9e21-524d5adee583,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cc8230db09d4adc93cd67a5a60e3e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:41Z,use_quota=True,user_id='a3c85b58c63f4612a15fa3fa2ebc8ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2440ee3b-b16a-471d-9e85-7eec4abccdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2440ee3b-b16a-471d-9e85-7eec4abccdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46d4f31-ab52-44b5-a115-9e91677ccdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46d4f31-ab52-44b5-a115-9e91677ccdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6544fd48-999a-4077-9e21-524d5adee583', 'volume_name': 'volume-6544fd48-999a-4077-9e21-524d5adee583', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9eb6de1-cf3e-4d41-8f47-41e680364812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9eb6de1-cf3e-4d41-8f47-41e680364812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bd052a-ed05-4468-9aa5-1253b7e30bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:41 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Volume 6544fd48-999a-4077-9e21-524d5adee583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6544fd48-999a-4077-9e21-524d5adee583', 'volume_size': 1} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-924577056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6544fd48-999a-4077-9e21-524d5adee583,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cc8230db09d4adc93cd67a5a60e3e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:41Z,use_quota=True,user_id='a3c85b58c63f4612a15fa3fa2ebc8ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Creating volume 6544fd48-999a-4077-9e21-524d5adee583 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:30:41 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:30:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6544fd48-999a-4077-9e21-524d5adee583 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:41 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6544fd48-999a-4077-9e21-524d5adee583 1073741824 Apr 13 17:30:41 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:42 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6544fd48-999a-4077-9e21-524d5adee583 1073741824" returned: 0 in 0.518s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6544fd48-999a-4077-9e21-524d5adee583 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:42 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6544fd48-999a-4077-9e21-524d5adee583 Apr 13 17:30:42 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:42 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6544fd48-999a-4077-9e21-524d5adee583" returned: 0 in 0.459s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:30:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bd052a-ed05-4468-9aa5-1253b7e30bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6544fd48-999a-4077-9e21-524d5adee583', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0472952-7e70-4a83-a1eb-9624ef30fd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:42 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Volume volume-6544fd48-999a-4077-9e21-524d5adee583 (6544fd48-999a-4077-9e21-524d5adee583): created successfully Apr 13 17:30:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0472952-7e70-4a83-a1eb-9624ef30fd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:42 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Flow 'volume_create_manager' (bb75e50e-786a-46eb-8bfa-137a1f87a752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:42 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-4aa70b2e-87fc-48cb-9a6a-55ad29881cdf tempest-VolumesListTestJSON-1932458064 None] Created volume successfully. Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Flow 'volume_create_manager' (e2a05f71-5485-41de-b98b-9050e3832023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321b9b07-7a9f-4d2f-8758-acf4605f889b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321b9b07-7a9f-4d2f-8758-acf4605f889b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-784171149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f109410-a983-4a75-8f66-4101806acc0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cc8230db09d4adc93cd67a5a60e3e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:44Z,use_quota=True,user_id='a3c85b58c63f4612a15fa3fa2ebc8ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25bc158-50a7-4f6d-9351-1eab779537ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25bc158-50a7-4f6d-9351-1eab779537ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d2dd65-c5bb-4d90-8dd0-fe12de9cd956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d2dd65-c5bb-4d90-8dd0-fe12de9cd956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f109410-a983-4a75-8f66-4101806acc0b', 'volume_name': 'volume-9f109410-a983-4a75-8f66-4101806acc0b', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa168a0f-864e-448b-97f1-024fee985554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa168a0f-864e-448b-97f1-024fee985554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94962f7-9f94-4725-a094-8d8e12f3128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:43 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Volume 9f109410-a983-4a75-8f66-4101806acc0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f109410-a983-4a75-8f66-4101806acc0b', 'volume_size': 1} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-784171149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f109410-a983-4a75-8f66-4101806acc0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cc8230db09d4adc93cd67a5a60e3e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:44Z,use_quota=True,user_id='a3c85b58c63f4612a15fa3fa2ebc8ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Creating volume 9f109410-a983-4a75-8f66-4101806acc0b {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:30:43 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:30:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f109410-a983-4a75-8f66-4101806acc0b 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:43 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f109410-a983-4a75-8f66-4101806acc0b 1073741824 Apr 13 17:30:43 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:44 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f109410-a983-4a75-8f66-4101806acc0b 1073741824" returned: 0 in 0.477s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f109410-a983-4a75-8f66-4101806acc0b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:44 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f109410-a983-4a75-8f66-4101806acc0b Apr 13 17:30:44 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:44 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f109410-a983-4a75-8f66-4101806acc0b" returned: 0 in 0.426s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:44 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:30:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94962f7-9f94-4725-a094-8d8e12f3128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f109410-a983-4a75-8f66-4101806acc0b', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f769df-1305-4d81-97f0-20203181efc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:44 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Volume volume-9f109410-a983-4a75-8f66-4101806acc0b (9f109410-a983-4a75-8f66-4101806acc0b): created successfully Apr 13 17:30:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f769df-1305-4d81-97f0-20203181efc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:44 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Flow 'volume_create_manager' (e2a05f71-5485-41de-b98b-9050e3832023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:44 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-7b935ade-c459-4962-a588-50b09077901e tempest-VolumesListTestJSON-1932458064 None] Created volume successfully. Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=69,cinder:UPDATE=93,cinder:DELETE=5,cinder:INSERT=27 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Flow 'volume_create_manager' (74bee446-b94c-452e-b1d0-b5d42f5b2441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a267cf77-96b9-4174-8a92-71c10576f936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a267cf77-96b9-4174-8a92-71c10576f936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-917999461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd5dacc-bc47-4e5f-b752-2d58e3b03206,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cc8230db09d4adc93cd67a5a60e3e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:46Z,use_quota=True,user_id='a3c85b58c63f4612a15fa3fa2ebc8ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a74494-e456-4f93-8fe8-265a7675bfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a74494-e456-4f93-8fe8-265a7675bfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c06562-347a-44e5-9812-7adc570f0435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c06562-347a-44e5-9812-7adc570f0435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd5dacc-bc47-4e5f-b752-2d58e3b03206', 'volume_name': 'volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1950481-c3dc-4cc2-99ac-c2c8c92d3a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1950481-c3dc-4cc2-99ac-c2c8c92d3a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af72d046-9a03-4797-9304-c2603d9cd7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:46 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Volume 7bd5dacc-bc47-4e5f-b752-2d58e3b03206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206', 'volume_size': 1} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-917999461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd5dacc-bc47-4e5f-b752-2d58e3b03206,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cc8230db09d4adc93cd67a5a60e3e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:30:46Z,use_quota=True,user_id='a3c85b58c63f4612a15fa3fa2ebc8ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Creating volume 7bd5dacc-bc47-4e5f-b752-2d58e3b03206 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:30:46 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:46 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206 1073741824 Apr 13 17:30:46 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:46 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206 1073741824" returned: 0 in 0.494s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:46 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206 Apr 13 17:30:46 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:47 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206" returned: 0 in 0.412s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:47 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:30:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af72d046-9a03-4797-9304-c2603d9cd7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fee244b-e690-4140-92e8-64d2c68a3ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:30:47 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Volume volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206 (7bd5dacc-bc47-4e5f-b752-2d58e3b03206): created successfully Apr 13 17:30:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fee244b-e690-4140-92e8-64d2c68a3ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:30:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Flow 'volume_create_manager' (74bee446-b94c-452e-b1d0-b5d42f5b2441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:30:47 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-cb05f1ed-9319-4a3e-99aa-43b0d57ced69 tempest-VolumesListTestJSON-1932458064 None] Created volume successfully. Apr 13 17:30:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "cinder-7bd5dacc-bc47-4e5f-b752-2d58e3b03206-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Lock "cinder-7bd5dacc-bc47-4e5f-b752-2d58e3b03206-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "cinder-quobyte-7bd5dacc-bc47-4e5f-b752-2d58e3b03206" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Lock "cinder-quobyte-7bd5dacc-bc47-4e5f-b752-2d58e3b03206" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:50 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84f145a-1ab2-4319-93d3-75335c87ee9e]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:50 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206 Apr 13 17:30:50 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:50 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206" returned: 0 in 0.498s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:50 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206 Apr 13 17:30:50 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:51 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7bd5dacc-bc47-4e5f-b752-2d58e3b03206" returned: 0 in 0.412s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Lock "cinder-quobyte-7bd5dacc-bc47-4e5f-b752-2d58e3b03206" released by "delete_volume" :: held 0.933s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Created reservations ['ede4bad5-f2be-4ea0-9575-64522e4d546a', '3fd3b0ff-6bc0-412a-8ab1-304c1b73a1ab', '1e46eda5-5dd2-46e6-aaad-0c941b836429', '9947605b-0660-4121-b82c-11a8f9596def'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:51 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:30:51 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "cinder-9f109410-a983-4a75-8f66-4101806acc0b-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Lock "cinder-9f109410-a983-4a75-8f66-4101806acc0b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "cinder-quobyte-9f109410-a983-4a75-8f66-4101806acc0b" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Lock "cinder-quobyte-9f109410-a983-4a75-8f66-4101806acc0b" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[91198868-f93c-4c9b-901f-f915690d9a2f]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f109410-a983-4a75-8f66-4101806acc0b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:51 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f109410-a983-4a75-8f66-4101806acc0b Apr 13 17:30:51 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:51 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.455s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:30:51 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Deleted volume successfully. Apr 13 17:30:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d64f9858-f333-4d53-a4db-1aafc27cc4b2 tempest-VolumesListTestJSON-1932458064 None] Lock "cinder-7bd5dacc-bc47-4e5f-b752-2d58e3b03206-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:52 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f109410-a983-4a75-8f66-4101806acc0b" returned: 0 in 0.477s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f109410-a983-4a75-8f66-4101806acc0b {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:52 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f109410-a983-4a75-8f66-4101806acc0b Apr 13 17:30:52 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:52 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9f109410-a983-4a75-8f66-4101806acc0b" returned: 0 in 0.426s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Lock "cinder-quobyte-9f109410-a983-4a75-8f66-4101806acc0b" released by "delete_volume" :: held 0.926s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Created reservations ['fe2c82c8-72fb-455a-aeed-615eee3a143b', 'b6f3a94b-0c98-4a1f-8ffd-9e97457d7ba1', 'be8b9f85-53d1-4f9b-8014-e20b008cee4d', '0459c1cd-a154-4924-ab07-3df11dd25ea7'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:52 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:30:52 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "cinder-6544fd48-999a-4077-9e21-524d5adee583-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Lock "cinder-6544fd48-999a-4077-9e21-524d5adee583-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "cinder-quobyte-6544fd48-999a-4077-9e21-524d5adee583" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Lock "cinder-quobyte-6544fd48-999a-4077-9e21-524d5adee583" acquired by "delete_volume" :: waited 0.007s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec48e80d-a2e4-49bf-8ea1-7be089342e62]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6544fd48-999a-4077-9e21-524d5adee583 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:52 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6544fd48-999a-4077-9e21-524d5adee583 Apr 13 17:30:52 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:52 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.447s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:30:52 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Deleted volume successfully. Apr 13 17:30:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-01a13b3f-998e-46ad-9b9d-88af623930be tempest-VolumesListTestJSON-1932458064 None] Lock "cinder-9f109410-a983-4a75-8f66-4101806acc0b-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:53 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6544fd48-999a-4077-9e21-524d5adee583" returned: 0 in 0.509s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6544fd48-999a-4077-9e21-524d5adee583 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:53 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6544fd48-999a-4077-9e21-524d5adee583 Apr 13 17:30:53 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:53 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=83,cinder:INSERT=35,cinder:UPDATE=113,cinder:DELETE=14 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:30:53 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6544fd48-999a-4077-9e21-524d5adee583" returned: 0 in 0.425s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Lock "cinder-quobyte-6544fd48-999a-4077-9e21-524d5adee583" released by "delete_volume" :: held 0.967s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:30:53 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Created reservations ['d05c4aca-0cd8-4ba6-86cd-608744caf65b', '65f649fc-9d1e-4a64-a3f8-197502fb0f10', '1777f92c-dfc6-46b9-93bf-27de6d869abf', '14f15c19-1867-40d3-aba9-716744a80451'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:30:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:30:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:30:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:30:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:30:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:30:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:30:53 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:30:53 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:30:54 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 13 17:30:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.463s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:30:54 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:30:54 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Deleted volume successfully. Apr 13 17:30:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-15244e21-a741-4119-bd9c-fefb5023606a tempest-VolumesListTestJSON-1932458064 None] Lock "cinder-6544fd48-999a-4077-9e21-524d5adee583-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Flow 'volume_create_manager' (b4945872-8210-4ad1-9348-a73799d5aa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21636e14-04e4-4d64-ba95-69e0d3b06021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21636e14-04e4-4d64-ba95-69e0d3b06021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-767834665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316936a4-ec0e-42b6-bddc-436870b8dc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322db8b2397d45709f30ab46838a63c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:01Z,use_quota=True,user_id='931ecff4430b41029f82dfeff32b37fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a584576d-5889-4229-9895-99ce1a266cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a584576d-5889-4229-9895-99ce1a266cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbdc8f1-99b4-4153-9ed8-25788b2f012a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbdc8f1-99b4-4153-9ed8-25788b2f012a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '316936a4-ec0e-42b6-bddc-436870b8dc54', 'volume_name': 'volume-316936a4-ec0e-42b6-bddc-436870b8dc54', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e4f8ae-c0b4-43a5-91f1-54b905080fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e4f8ae-c0b4-43a5-91f1-54b905080fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b27ee55-6ae9-42c3-baca-cdd1c9b72b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Volume 316936a4-ec0e-42b6-bddc-436870b8dc54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-316936a4-ec0e-42b6-bddc-436870b8dc54', 'volume_size': 1} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-767834665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316936a4-ec0e-42b6-bddc-436870b8dc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322db8b2397d45709f30ab46838a63c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:01Z,use_quota=True,user_id='931ecff4430b41029f82dfeff32b37fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Creating volume 316936a4-ec0e-42b6-bddc-436870b8dc54 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:01 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:01 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 1073741824 Apr 13 17:31:01 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Flow 'volume_create_manager' (63067d61-1c79-4b3a-ac65-7bc5a0a0543f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df65d5fc-5a2b-45df-8dbc-36023aea4bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df65d5fc-5a2b-45df-8dbc-36023aea4bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1271393195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e34364a3-53e0-4dc9-abf0-6b3aadd9badc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111248813f44f88bf37ce3bbf7e3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:01Z,use_quota=True,user_id='76c7ced60e584bd18083f740194771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8684d24c-f545-45ee-922e-05924f2dd8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8684d24c-f545-45ee-922e-05924f2dd8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f28b07-c404-4c60-b834-00e99cdd9ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f28b07-c404-4c60-b834-00e99cdd9ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e34364a3-53e0-4dc9-abf0-6b3aadd9badc', 'volume_name': 'volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0802fa-a49b-4c06-abe6-1dfda66a470b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0802fa-a49b-4c06-abe6-1dfda66a470b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51b71a3-5352-459b-87b7-bf4568a36ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume e34364a3-53e0-4dc9-abf0-6b3aadd9badc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc', 'volume_size': 1} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Flow 'volume_create_manager' (1dade80e-f97d-4281-8197-e29d71283a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbf135a-bad7-4e61-9f98-3958a7767180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbf135a-bad7-4e61-9f98-3958a7767180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2063710938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb461c70-151e-446f-bc64-6c8506a4f554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29954a70814344b08e19adb806f8d97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:01Z,use_quota=True,user_id='abb7177be71448099017839c87b11eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23aa28cc-1e21-4a24-8182-45596fce0786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23aa28cc-1e21-4a24-8182-45596fce0786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab4d8c1-d9b6-469f-a2a4-2f4847ca2d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab4d8c1-d9b6-469f-a2a4-2f4847ca2d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb461c70-151e-446f-bc64-6c8506a4f554', 'volume_name': 'volume-fb461c70-151e-446f-bc64-6c8506a4f554', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b38de1-9886-426e-9f35-910db0c05b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b38de1-9886-426e-9f35-910db0c05b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f34b1f6-1189-489a-99c2-c9b242b346e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Volume fb461c70-151e-446f-bc64-6c8506a4f554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb461c70-151e-446f-bc64-6c8506a4f554', 'volume_size': 1} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Flow 'volume_create_manager' (086e8c6f-5a24-4906-aaca-38c1482e2922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263e98f3-6ebc-4e80-a3c7-2fc28352f001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263e98f3-6ebc-4e80-a3c7-2fc28352f001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-840489339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29954a70814344b08e19adb806f8d97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:02Z,use_quota=True,user_id='abb7177be71448099017839c87b11eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2587987-0f08-44bf-b331-796573e469f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2587987-0f08-44bf-b331-796573e469f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a2cc17-8d14-47a3-b4ac-8a053d654d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a2cc17-8d14-47a3-b4ac-8a053d654d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec', 'volume_name': 'volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91db811f-fe39-4c5c-bdd2-156b918a3523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91db811f-fe39-4c5c-bdd2-156b918a3523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82cc9ff6-95c3-4739-96d2-4c12bdec62e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Volume 28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec', 'volume_size': 1} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Flow 'volume_create_manager' (748ab522-f9db-4cc0-bc85-56fcea9173d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a218fb0d-aab7-43fe-9d92-26eb5a3fc364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a218fb0d-aab7-43fe-9d92-26eb5a3fc364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1199043060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bc6bf8-c1cf-40b1-938d-31a8cffa81a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29954a70814344b08e19adb806f8d97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:02Z,use_quota=True,user_id='abb7177be71448099017839c87b11eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d916984-0c7e-4cb9-ae29-1f371efc431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d916984-0c7e-4cb9-ae29-1f371efc431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccb18d1-dc68-4fec-b414-6a40f693b982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccb18d1-dc68-4fec-b414-6a40f693b982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35bc6bf8-c1cf-40b1-938d-31a8cffa81a2', 'volume_name': 'volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057f67b2-2259-4b7f-864d-bf9ce49eb80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057f67b2-2259-4b7f-864d-bf9ce49eb80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1030dd-71b5-429a-9932-bfdda3eda8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:01 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Volume 35bc6bf8-c1cf-40b1-938d-31a8cffa81a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2', 'volume_size': 1} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 1073741824" returned: 0 in 0.724s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:02 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 Apr 13 17:31:02 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Flow 'volume_create_manager' (c98a01b0-b3ae-4e73-b4c4-cc23ec0944f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67be04ee-ee15-4ab3-84bb-4c05ea7f96d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67be04ee-ee15-4ab3-84bb-4c05ea7f96d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-985621321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0b24ee-0883-44d1-ac24-31c4df4eb819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29954a70814344b08e19adb806f8d97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:02Z,use_quota=True,user_id='abb7177be71448099017839c87b11eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5db1e80-f869-4373-b0ff-eceee8367e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5db1e80-f869-4373-b0ff-eceee8367e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3244d8da-5ea9-44fb-893e-c3f041bff018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3244d8da-5ea9-44fb-893e-c3f041bff018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0b24ee-0883-44d1-ac24-31c4df4eb819', 'volume_name': 'volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae7fc87-653e-4eca-8cc9-e5f42c3db3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae7fc87-653e-4eca-8cc9-e5f42c3db3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b1aad4-a722-4a97-93ed-208b2cb831a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:02 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Volume 8a0b24ee-0883-44d1-ac24-31c4df4eb819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819', 'volume_size': 1} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Flow 'volume_create_manager' (d2a0d7c5-297b-4f10-8497-212fa00717aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5723006-5eeb-48fc-8f55-9c94b829da5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5723006-5eeb-48fc-8f55-9c94b829da5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744735018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b919f1-442f-46d2-92ab-d8b3c059e624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29954a70814344b08e19adb806f8d97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:02Z,use_quota=True,user_id='abb7177be71448099017839c87b11eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d84e56-5181-4c22-b4b7-b16e891c785c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d84e56-5181-4c22-b4b7-b16e891c785c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b08385-3aa4-4bb0-ad22-3c541ef26820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b08385-3aa4-4bb0-ad22-3c541ef26820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b919f1-442f-46d2-92ab-d8b3c059e624', 'volume_name': 'volume-e2b919f1-442f-46d2-92ab-d8b3c059e624', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3707a8-ef22-4c6b-af5c-4f352b805d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3707a8-ef22-4c6b-af5c-4f352b805d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7659075c-9f3c-40c7-b6a4-70186aae69da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:02 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Volume e2b919f1-442f-46d2-92ab-d8b3c059e624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b919f1-442f-46d2-92ab-d8b3c059e624', 'volume_size': 1} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:02 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54" returned: 0 in 0.555s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.183s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1271393195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e34364a3-53e0-4dc9-abf0-6b3aadd9badc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111248813f44f88bf37ce3bbf7e3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:01Z,use_quota=True,user_id='76c7ced60e584bd18083f740194771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Creating volume e34364a3-53e0-4dc9-abf0-6b3aadd9badc {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:02 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:02 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc 1073741824 Apr 13 17:31:02 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b27ee55-6ae9-42c3-baca-cdd1c9b72b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-316936a4-ec0e-42b6-bddc-436870b8dc54', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4330c8-54a9-42ae-83ac-0d45bb2a4aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:02 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Volume volume-316936a4-ec0e-42b6-bddc-436870b8dc54 (316936a4-ec0e-42b6-bddc-436870b8dc54): created successfully Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4330c8-54a9-42ae-83ac-0d45bb2a4aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:02 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Flow 'volume_create_manager' (b4945872-8210-4ad1-9348-a73799d5aa42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ac500f1a-b25d-40b9-95b7-a00b704c8380 tempest-VolumeDependencyTests-946038410 None] Created volume successfully. Apr 13 17:31:03 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc 1073741824" returned: 0 in 0.515s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:03 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc Apr 13 17:31:03 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:03 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc" returned: 0 in 0.505s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.130s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2063710938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb461c70-151e-446f-bc64-6c8506a4f554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29954a70814344b08e19adb806f8d97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:01Z,use_quota=True,user_id='abb7177be71448099017839c87b11eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Creating volume fb461c70-151e-446f-bc64-6c8506a4f554 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:03 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb461c70-151e-446f-bc64-6c8506a4f554 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:03 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb461c70-151e-446f-bc64-6c8506a4f554 1073741824 Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51b71a3-5352-459b-87b7-bf4568a36ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:03 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e1fbe4-5479-43ae-9899-f4f35edb2864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:03 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc (e34364a3-53e0-4dc9-abf0-6b3aadd9badc): created successfully Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e1fbe4-5479-43ae-9899-f4f35edb2864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:03 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Flow 'volume_create_manager' (63067d61-1c79-4b3a-ac65-7bc5a0a0543f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:03 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e500e29b-bbc5-4b10-99d0-11a93db03af0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created volume successfully. Apr 13 17:31:04 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb461c70-151e-446f-bc64-6c8506a4f554 1073741824" returned: 0 in 0.528s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb461c70-151e-446f-bc64-6c8506a4f554 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:04 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb461c70-151e-446f-bc64-6c8506a4f554 Apr 13 17:31:04 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:04 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb461c70-151e-446f-bc64-6c8506a4f554" returned: 0 in 0.525s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.012s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-840489339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29954a70814344b08e19adb806f8d97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:02Z,use_quota=True,user_id='abb7177be71448099017839c87b11eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Creating volume 28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:04 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f34b1f6-1189-489a-99c2-c9b242b346e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb461c70-151e-446f-bc64-6c8506a4f554', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:04 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec 1073741824 Apr 13 17:31:04 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766a4f54-9c62-46ca-82fd-09ca083a25bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:04 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Volume volume-fb461c70-151e-446f-bc64-6c8506a4f554 (fb461c70-151e-446f-bc64-6c8506a4f554): created successfully Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766a4f54-9c62-46ca-82fd-09ca083a25bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:04 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Flow 'volume_create_manager' (1dade80e-f97d-4281-8197-e29d71283a69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:04 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-5fee8c4b-5fda-47d1-86ee-bff358df4ee1 tempest-CreateVolumesFromImageTest-340206541 None] Created volume successfully. Apr 13 17:31:05 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec 1073741824" returned: 0 in 0.573s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:05 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec Apr 13 17:31:05 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:05 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec" returned: 0 in 0.492s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.825s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1199043060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bc6bf8-c1cf-40b1-938d-31a8cffa81a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29954a70814344b08e19adb806f8d97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:02Z,use_quota=True,user_id='abb7177be71448099017839c87b11eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Creating volume 35bc6bf8-c1cf-40b1-938d-31a8cffa81a2 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:05 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82cc9ff6-95c3-4739-96d2-4c12bdec62e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:05 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2 1073741824 Apr 13 17:31:05 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a903c84-4d7a-4600-9a05-003de55eed23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:05 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Volume volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec (28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec): created successfully Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a903c84-4d7a-4600-9a05-003de55eed23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:05 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Flow 'volume_create_manager' (086e8c6f-5a24-4906-aaca-38c1482e2922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:05 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-78c6e40e-c012-4221-b875-85997d2cdc1b tempest-CreateVolumesFromImageTest-340206541 None] Created volume successfully. Apr 13 17:31:06 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2 1073741824" returned: 0 in 0.574s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:06 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2 Apr 13 17:31:06 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:06 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2" returned: 0 in 0.476s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.703s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-985621321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0b24ee-0883-44d1-ac24-31c4df4eb819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29954a70814344b08e19adb806f8d97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:02Z,use_quota=True,user_id='abb7177be71448099017839c87b11eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Creating volume 8a0b24ee-0883-44d1-ac24-31c4df4eb819 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:06 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1030dd-71b5-429a-9932-bfdda3eda8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f541e4-6b05-4005-a197-db1840a8cc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:06 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819 1073741824 Apr 13 17:31:06 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:06 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Volume volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2 (35bc6bf8-c1cf-40b1-938d-31a8cffa81a2): created successfully Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f541e4-6b05-4005-a197-db1840a8cc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:06 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Flow 'volume_create_manager' (748ab522-f9db-4cc0-bc85-56fcea9173d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:06 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f5b22515-ee47-4967-9b29-0f664a7af44e tempest-CreateVolumesFromImageTest-340206541 None] Created volume successfully. Apr 13 17:31:07 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819 1073741824" returned: 0 in 0.525s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:07 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819 Apr 13 17:31:07 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:07 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819" returned: 0 in 0.469s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.506s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744735018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b919f1-442f-46d2-92ab-d8b3c059e624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29954a70814344b08e19adb806f8d97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:02Z,use_quota=True,user_id='abb7177be71448099017839c87b11eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Creating volume e2b919f1-442f-46d2-92ab-d8b3c059e624 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:07 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e2b919f1-442f-46d2-92ab-d8b3c059e624 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b1aad4-a722-4a97-93ed-208b2cb831a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:07 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e2b919f1-442f-46d2-92ab-d8b3c059e624 1073741824 Apr 13 17:31:07 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0dc9b8-990c-4e32-bcd2-8dc6f6439979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:07 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Volume volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819 (8a0b24ee-0883-44d1-ac24-31c4df4eb819): created successfully Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0dc9b8-990c-4e32-bcd2-8dc6f6439979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:07 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Flow 'volume_create_manager' (c98a01b0-b3ae-4e73-b4c4-cc23ec0944f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:07 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-ea7a67df-c672-4404-b7da-6e5dc1745856 tempest-CreateVolumesFromImageTest-340206541 None] Created volume successfully. Apr 13 17:31:08 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e2b919f1-442f-46d2-92ab-d8b3c059e624 1073741824" returned: 0 in 0.532s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e2b919f1-442f-46d2-92ab-d8b3c059e624 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:08 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e2b919f1-442f-46d2-92ab-d8b3c059e624 Apr 13 17:31:08 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:08 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e2b919f1-442f-46d2-92ab-d8b3c059e624" returned: 0 in 0.523s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.477s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:08 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] Creating offline snapshot 1960c294-a163-4c75-b855-c8be16bb5b27 of volume 316936a4-ec0e-42b6-bddc-436870b8dc54 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:31:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7659075c-9f3c-40c7-b6a4-70186aae69da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b919f1-442f-46d2-92ab-d8b3c059e624', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed122978-0bdf-4905-bf66-e370c7ed87b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:09 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89367b4-b8a8-4e4f-8bc2-cb306a987b04]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:09 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Volume volume-e2b919f1-442f-46d2-92ab-d8b3c059e624 (e2b919f1-442f-46d2-92ab-d8b3c059e624): created successfully Apr 13 17:31:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed122978-0bdf-4905-bf66-e370c7ed87b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:09 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Flow 'volume_create_manager' (d2a0d7c5-297b-4f10-8497-212fa00717aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:09 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-0d82b01b-d927-481b-ba6a-e2a8d0349e2d tempest-CreateVolumesFromImageTest-340206541 None] Created volume successfully. Apr 13 17:31:09 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 Apr 13 17:31:09 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:09 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54" returned: 0 in 0.530s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:09 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 1G Apr 13 17:31:09 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "cinder-e2b919f1-442f-46d2-92ab-d8b3c059e624-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-e2b919f1-442f-46d2-92ab-d8b3c059e624-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:10 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 1G" returned: 0 in 0.592s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-316936a4-ec0e-42b6-bddc-436870b8dc54 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "cinder-quobyte-e2b919f1-442f-46d2-92ab-d8b3c059e624" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:10 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-316936a4-ec0e-42b6-bddc-436870b8dc54 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 Apr 13 17:31:10 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-quobyte-e2b919f1-442f-46d2-92ab-d8b3c059e624" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:10 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:10 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aef8cf9-5bd2-4fef-beba-608faa80a0ee]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e2b919f1-442f-46d2-92ab-d8b3c059e624 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:10 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e2b919f1-442f-46d2-92ab-d8b3c059e624 Apr 13 17:31:10 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:10 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e2b919f1-442f-46d2-92ab-d8b3c059e624" returned: 0 in 0.523s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e2b919f1-442f-46d2-92ab-d8b3c059e624 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:10 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e2b919f1-442f-46d2-92ab-d8b3c059e624 Apr 13 17:31:10 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:10 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-316936a4-ec0e-42b6-bddc-436870b8dc54 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27" returned: 0 in 0.613s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:10 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 is being set with open permissions: ugo+rw Apr 13 17:31:10 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:10 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 Apr 13 17:31:10 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:11 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e2b919f1-442f-46d2-92ab-d8b3c059e624" returned: 0 in 0.445s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-quobyte-e2b919f1-442f-46d2-92ab-d8b3c059e624" released by "delete_volume" :: held 0.994s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:11 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27" returned: 0 in 0.456s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Created reservations ['b2c22aa5-d42c-4e66-a5dc-6a22c903ed2d', '3cc53e52-ff65-41f1-92d5-3bc11b43184b', 'e1dac6c7-e31c-4efb-b562-a7e08fe15f12', '92dab560-cb06-46e1-84ab-a48615d932d9'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:11 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.info Apr 13 17:31:11 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:11 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:11 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:11 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.info" returned: 0 in 0.492s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:11 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.info is being set with open permissions: ugo+rw Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:11 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.450s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:11 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Deleted volume successfully. Apr 13 17:31:11 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.info Apr 13 17:31:11 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-265c6577-cfb7-4e3c-9fcc-928208998123 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-e2b919f1-442f-46d2-92ab-d8b3c059e624-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:11 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:12 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.info" returned: 0 in 0.523s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.299s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.564s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Creating offline snapshot fed01d04-24a4-414f-bafc-12332aeb4b57 of volume e34364a3-53e0-4dc9-abf0-6b3aadd9badc {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe276d4-87f9-4370-ae84-7ae302425ea4]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "cinder-8a0b24ee-0883-44d1-ac24-31c4df4eb819-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:12 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-dc31b8fd-a9f1-4ac7-b4b3-52927abfc6dd tempest-VolumeDependencyTests-946038410 None] Create snapshot completed successfully Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-8a0b24ee-0883-44d1-ac24-31c4df4eb819-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "cinder-quobyte-8a0b24ee-0883-44d1-ac24-31c4df4eb819" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-quobyte-8a0b24ee-0883-44d1-ac24-31c4df4eb819" acquired by "delete_volume" :: waited 0.007s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0589ad4-0f3a-440d-81d9-bb3103533396]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:12 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc Apr 13 17:31:12 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:12 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819 Apr 13 17:31:12 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:12 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc" returned: 0 in 0.666s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:12 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:13 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 1G Apr 13 17:31:13 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:13 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819" returned: 0 in 0.830s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:13 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819 Apr 13 17:31:13 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Flow 'volume_create_manager' (88c66419-c765-4e59-9115-5ebf761628ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4f40e3-4607-4e21-8b61-cb248ada395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4f40e3-4607-4e21-8b61-cb248ada395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-855203950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7590b1c0-80d1-4e92-96f2-9b0defe86418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322db8b2397d45709f30ab46838a63c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1960c294-a163-4c75-b855-c8be16bb5b27,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:13Z,use_quota=True,user_id='931ecff4430b41029f82dfeff32b37fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d152c53a-11ab-4940-a005-83f41bcca08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d152c53a-11ab-4940-a005-83f41bcca08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9957dd5a-ef32-4cae-b47d-e4ea6875be16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9957dd5a-ef32-4cae-b47d-e4ea6875be16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7590b1c0-80d1-4e92-96f2-9b0defe86418', 'volume_name': 'volume-7590b1c0-80d1-4e92-96f2-9b0defe86418', 'volume_size': 1, 'snapshot_id': '1960c294-a163-4c75-b855-c8be16bb5b27'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ad354b-6dc3-440d-8b5c-98ac30b976ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ad354b-6dc3-440d-8b5c-98ac30b976ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e55c4b-fe6c-4b48-94a5-1c608384c012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:13 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Volume 7590b1c0-80d1-4e92-96f2-9b0defe86418: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7590b1c0-80d1-4e92-96f2-9b0defe86418', 'volume_size': 1, 'snapshot_id': '1960c294-a163-4c75-b855-c8be16bb5b27'} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:13 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 1G" returned: 0 in 0.727s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:13 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 Apr 13 17:31:13 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:13 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8a0b24ee-0883-44d1-ac24-31c4df4eb819" returned: 0 in 0.552s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-quobyte-8a0b24ee-0883-44d1-ac24-31c4df4eb819" released by "delete_volume" :: held 1.407s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Created reservations ['f4ba1b0d-615a-463c-b5a0-4a5e5bf04fb4', '31a67c7e-b7d9-44fb-9221-770d1cf97c9b', '00928f6e-60fc-4b74-892b-017b573bad52', 'eb852b8f-30ca-47b6-b6ad-b07fc558f9ee'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:13 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:13 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:13 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:14 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57" returned: 0 in 0.629s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:14 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 is being set with open permissions: ugo+rw Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:14 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 Apr 13 17:31:14 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:14 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.619s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:14 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Deleted volume successfully. Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "cinder-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-05410e22-bf6d-424e-bcc8-2ab46b864129 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-8a0b24ee-0883-44d1-ac24-31c4df4eb819-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "cinder-quobyte-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-quobyte-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b29c5b-2089-44a6-958a-fb2c130b6585]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:14 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2 Apr 13 17:31:14 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:14 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57" returned: 0 in 0.501s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:14 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:14 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.info Apr 13 17:31:14 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:15 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2" returned: 0 in 0.571s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:15 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2 Apr 13 17:31:15 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:15 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.info" returned: 0 in 0.539s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:15 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.info is being set with open permissions: ugo+rw Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:15 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.info Apr 13 17:31:15 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:15 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2" returned: 0 in 0.529s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-quobyte-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2" released by "delete_volume" :: held 1.134s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Created reservations ['dc23d7e0-6abd-48b3-bb29-e72dd24bd9c8', '7d51b638-520b-4477-9cdd-efc108b6068a', 'be3abe7c-b964-43e8-b578-a94b8caa9710', 'b416648f-30c2-462d-9aae-49d8eac6e610'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:15 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:15 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:15 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.info" returned: 0 in 0.506s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.642s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.411s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-quobyte-1960c294-a163-4c75-b855-c8be16bb5b27-7590b1c0-80d1-4e92-96f2-9b0defe86418" by "_create_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-1960c294-a163-4c75-b855-c8be16bb5b27-7590b1c0-80d1-4e92-96f2-9b0defe86418" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Creating volume 7590b1c0-80d1-4e92-96f2-9b0defe86418 from snapshot 1960c294-a163-4c75-b855-c8be16bb5b27 {{(pid=81998) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-quobyte-7590b1c0-80d1-4e92-96f2-9b0defe86418" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:15 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f3481969-e7a7-4e46-a2f6-eb1d7bb923c6 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Create snapshot completed successfully Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-7590b1c0-80d1-4e92-96f2-9b0defe86418" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] snapshot: 1960c294-a163-4c75-b855-c8be16bb5b27, volume: 7590b1c0-80d1-4e92-96f2-9b0defe86418, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:15 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aebe2d3-8aad-4a46-8588-94bc7341b711]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:16 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 Apr 13 17:31:16 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:16 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.442s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:16 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Deleted volume successfully. Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-557bc263-dc65-4547-91e5-312d3b729249 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-35bc6bf8-c1cf-40b1-938d-31a8cffa81a2-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Flow 'volume_create_manager' (6013fcec-a551-40fb-abf0-c003ab52bfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6cebb8-7c20-4fdc-ad93-365aceaf73e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6cebb8-7c20-4fdc-ad93-365aceaf73e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-865182001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de1d173-9531-4131-bdca-ead4b0c19214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111248813f44f88bf37ce3bbf7e3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:16Z,use_quota=True,user_id='76c7ced60e584bd18083f740194771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92902e7-08ed-4c49-8ec5-30f9edc6720f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92902e7-08ed-4c49-8ec5-30f9edc6720f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c0d7ff-a89c-498d-a94f-6ac89c15ab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c0d7ff-a89c-498d-a94f-6ac89c15ab68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de1d173-9531-4131-bdca-ead4b0c19214', 'volume_name': 'volume-7de1d173-9531-4131-bdca-ead4b0c19214', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c1c6df-a99b-4b32-ad48-2be2d266cb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c1c6df-a99b-4b32-ad48-2be2d266cb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e54f68-be9d-4d11-a7ff-65d7a67508e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:16 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume 7de1d173-9531-4131-bdca-ead4b0c19214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de1d173-9531-4131-bdca-ead4b0c19214', 'volume_size': 1} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:16 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27" returned: 0 in 0.706s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-316936a4-ec0e-42b6-bddc-436870b8dc54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[db501e31-c0ae-4bed-bb63-7d86e3283434]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "cinder-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Flow 'volume_create_manager' (e7f723f7-4113-41b6-995f-beda7ad23f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:16 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b52b53-8527-43f4-bd2e-1efd5254d658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:16 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b52b53-8527-43f4-bd2e-1efd5254d658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-558898856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296ab248-f5a6-4871-8335-7b93bbc6ca4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111248813f44f88bf37ce3bbf7e3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:17Z,use_quota=True,user_id='76c7ced60e584bd18083f740194771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:16 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57194243-82b5-4f51-a1ba-30799a386cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57194243-82b5-4f51-a1ba-30799a386cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7119849f-ba87-41f0-960e-14d175b8aca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7119849f-ba87-41f0-960e-14d175b8aca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '296ab248-f5a6-4871-8335-7b93bbc6ca4d', 'volume_name': 'volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fa8948-0e81-4f2a-b62d-1c624d04ee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fa8948-0e81-4f2a-b62d-1c624d04ee4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e8c47c-f997-45ac-bc5d-c8be3eaf9b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume 296ab248-f5a6-4871-8335-7b93bbc6ca4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d', 'volume_size': 1} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "cinder-quobyte-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-quobyte-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a96ab8-1148-4f4b-bcfc-8c17cba0017c]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Flow 'volume_create_manager' (cd192666-0856-493b-962f-c9e553097497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbb4c04-dfb3-45aa-a1ad-97d2bf43c5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbb4c04-dfb3-45aa-a1ad-97d2bf43c5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1440792788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f68c5d-0386-4376-8a65-cec537908857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111248813f44f88bf37ce3bbf7e3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:17Z,use_quota=True,user_id='76c7ced60e584bd18083f740194771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f110d356-8847-4098-892e-e4b36bc66085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f110d356-8847-4098-892e-e4b36bc66085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87250939-7609-462c-a2a4-a2d410d6e13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87250939-7609-462c-a2a4-a2d410d6e13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f68c5d-0386-4376-8a65-cec537908857', 'volume_name': 'volume-11f68c5d-0386-4376-8a65-cec537908857', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c32a090-d335-4e50-a595-8a2a24636f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c32a090-d335-4e50-a595-8a2a24636f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef45de3-bf58-4922-9144-042dd47dc984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume 11f68c5d-0386-4376-8a65-cec537908857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f68c5d-0386-4376-8a65-cec537908857', 'volume_size': 1} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:17 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec Apr 13 17:31:17 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Flow 'volume_create_manager' (13945352-42c1-4add-931a-50ae82b2f319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0899bb36-ee56-4275-9a31-36c9a901f24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0899bb36-ee56-4275-9a31-36c9a901f24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1593240629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111248813f44f88bf37ce3bbf7e3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:18Z,use_quota=True,user_id='76c7ced60e584bd18083f740194771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f808aee6-da33-4864-b47b-cbf7a604c3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f808aee6-da33-4864-b47b-cbf7a604c3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eac473c-5f10-4e4a-92b8-929f8eee1536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eac473c-5f10-4e4a-92b8-929f8eee1536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1', 'volume_name': 'volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7ee106-5840-4aa6-b7aa-73bfa2f779a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7ee106-5840-4aa6-b7aa-73bfa2f779a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07da3e52-7623-4baf-910a-fec7d92bed6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:17 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1', 'volume_size': 1} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54" returned: 0 in 1.195s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418 not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:17 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418 Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:17 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Flow 'volume_create_manager' (8123ffd3-729f-455d-9abc-aeaa01150342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:17 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2d6798-0e5c-4353-847d-646a068f9736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2d6798-0e5c-4353-847d-646a068f9736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2030679577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e969d2c-a1b4-4371-96f2-4878fbbe0fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111248813f44f88bf37ce3bbf7e3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:18Z,use_quota=True,user_id='76c7ced60e584bd18083f740194771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd548667-c6a5-4935-bb83-51c7ba91aa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd548667-c6a5-4935-bb83-51c7ba91aa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e630e12-b0e7-4835-b7df-d711ddc3e03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e630e12-b0e7-4835-b7df-d711ddc3e03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e969d2c-a1b4-4371-96f2-4878fbbe0fb3', 'volume_name': 'volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4439a3f5-71e4-4126-b9ad-f400a3eaf0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4439a3f5-71e4-4126-b9ad-f400a3eaf0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd00539-c568-4c28-8645-019928b6d22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:18 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume 0e969d2c-a1b4-4371-96f2-4878fbbe0fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3', 'volume_size': 1} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:18 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec" returned: 0 in 0.920s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:18 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec Apr 13 17:31:18 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Flow 'volume_create_manager' (d0cff3f7-a939-44da-a0c5-6b8aa1a335d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5128c5-796f-48e8-9ecd-ce02787895f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5128c5-796f-48e8-9ecd-ce02787895f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-655263123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faff20da-a136-4c7f-885e-fc3d07261422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a052c97c3d714e54b1642f188e73596c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:18Z,use_quota=True,user_id='a2c99554708349a8809b1217fb695103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c819b5b-cfca-433d-a830-968de36fb44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c819b5b-cfca-433d-a830-968de36fb44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62dd6a7-5ef8-45af-be79-932967299edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62dd6a7-5ef8-45af-be79-932967299edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faff20da-a136-4c7f-885e-fc3d07261422', 'volume_name': 'volume-faff20da-a136-4c7f-885e-fc3d07261422', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16dc5981-0be9-42c8-a824-a1a4aed30975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16dc5981-0be9-42c8-a824-a1a4aed30975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0958ee54-2668-4817-88a8-2045870103fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:18 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Volume faff20da-a136-4c7f-885e-fc3d07261422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faff20da-a136-4c7f-885e-fc3d07261422', 'volume_size': 1} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:18 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec" returned: 0 in 0.654s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-quobyte-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec" released by "delete_volume" :: held 1.607s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Created reservations ['a28cd62b-8ef7-4f4d-96a0-c6479c87fad7', '34692b2c-9f71-4c16-9398-2ba48048597b', '6b343b9e-b449-42f7-892b-8df34e87aeb5', '813f49b8-52d9-4ba9-9fc7-904bec6d623c'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:18 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:19 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:19 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "cinder-fb461c70-151e-446f-bc64-6c8506a4f554-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-fb461c70-151e-446f-bc64-6c8506a4f554-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "cinder-quobyte-fb461c70-151e-446f-bc64-6c8506a4f554" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:19 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-quobyte-fb461c70-151e-446f-bc64-6c8506a4f554" acquired by "delete_volume" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:19 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cf79ca-10be-400b-a63c-caf06ca1069f]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:19 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb461c70-151e-446f-bc64-6c8506a4f554 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:20 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb461c70-151e-446f-bc64-6c8506a4f554 Apr 13 17:31:20 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:20 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 1.192s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:20 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:20 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Deleted volume successfully. Apr 13 17:31:20 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-95ac3aa7-ddab-453c-a7c8-f98dde2ef805 tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-28fa9d0b-0f16-4cc0-b3c7-e43fb7cfdaec-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:20 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418" returned: 0 in 2.490s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:20 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f10edd5-4b41-4e00-8181-f3fbd63450a0]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:20 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 Apr 13 17:31:20 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:20 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb461c70-151e-446f-bc64-6c8506a4f554" returned: 0 in 1.042s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:20 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb461c70-151e-446f-bc64-6c8506a4f554 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:20 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb461c70-151e-446f-bc64-6c8506a4f554 Apr 13 17:31:20 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:21 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54" returned: 0 in 0.640s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418 {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:31:21 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Converted 1024.00 MB image at 411.15 MB/s Apr 13 17:31:21 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418 is being set with open permissions: ugo+rw Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:21 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418 Apr 13 17:31:21 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:21 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-fb461c70-151e-446f-bc64-6c8506a4f554" returned: 0 in 0.465s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-quobyte-fb461c70-151e-446f-bc64-6c8506a4f554" released by "delete_volume" :: held 1.551s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Created reservations ['a70bb5dc-a576-4bfc-966a-7b90059d00f2', 'c688da9c-6890-4f59-8a9f-f4b34ad134bc', 'b8d269f3-fb28-4a3c-8c44-d0f88f924702', 'a3095285-a113-4195-8a12-3e918e887887'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:21 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:21 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:21 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418" returned: 0 in 0.432s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-7590b1c0-80d1-4e92-96f2-9b0defe86418" released by "_copy_volume_from_snapshot" :: held 5.528s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-1960c294-a163-4c75-b855-c8be16bb5b27-7590b1c0-80d1-4e92-96f2-9b0defe86418" released by "_create_volume_from_snapshot" :: held 5.554s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.574s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.977s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-865182001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de1d173-9531-4131-bdca-ead4b0c19214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111248813f44f88bf37ce3bbf7e3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:16Z,use_quota=True,user_id='76c7ced60e584bd18083f740194771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Creating volume 7de1d173-9531-4131-bdca-ead4b0c19214 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:21 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7de1d173-9531-4131-bdca-ead4b0c19214 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:21 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7de1d173-9531-4131-bdca-ead4b0c19214 1073741824 Apr 13 17:31:21 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e55c4b-fe6c-4b48-94a5-1c608384c012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7590b1c0-80d1-4e92-96f2-9b0defe86418', 'volume_size': 1, 'snapshot_id': '1960c294-a163-4c75-b855-c8be16bb5b27'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ff0241-70a0-41b1-bd50-adb48d7c0261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:21 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Volume volume-7590b1c0-80d1-4e92-96f2-9b0defe86418 (7590b1c0-80d1-4e92-96f2-9b0defe86418): created successfully Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ff0241-70a0-41b1-bd50-adb48d7c0261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Flow 'volume_create_manager' (88c66419-c765-4e59-9115-5ebf761628ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:21 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-1690c8a2-52b1-4921-8647-28862b359377 tempest-VolumeDependencyTests-946038410 None] Created volume successfully. Apr 13 17:31:21 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.472s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:21 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Deleted volume successfully. Apr 13 17:31:21 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-caecc523-04da-4c77-b31d-9790fd2336ad tempest-CreateVolumesFromImageTest-340206541 None] Lock "cinder-fb461c70-151e-446f-bc64-6c8506a4f554-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:22 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7de1d173-9531-4131-bdca-ead4b0c19214 1073741824" returned: 0 in 0.523s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7de1d173-9531-4131-bdca-ead4b0c19214 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:22 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7de1d173-9531-4131-bdca-ead4b0c19214 Apr 13 17:31:22 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-1960c294-a163-4c75-b855-c8be16bb5b27-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Lock "cinder-1960c294-a163-4c75-b855-c8be16bb5b27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-quobyte-316936a4-ec0e-42b6-bddc-436870b8dc54" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-316936a4-ec0e-42b6-bddc-436870b8dc54" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-quobyte-1960c294-a163-4c75-b855-c8be16bb5b27" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-1960c294-a163-4c75-b855-c8be16bb5b27" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Deleting offline snapshot 1960c294-a163-4c75-b855-c8be16bb5b27 of volume 316936a4-ec0e-42b6-bddc-436870b8dc54 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] snapshot_file for this snap is: volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f6875d-d311-4149-a959-b94053ac6fe5]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:22 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 Apr 13 17:31:22 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:22 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7de1d173-9531-4131-bdca-ead4b0c19214" returned: 0 in 0.564s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.576s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-558898856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296ab248-f5a6-4871-8335-7b93bbc6ca4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111248813f44f88bf37ce3bbf7e3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:17Z,use_quota=True,user_id='76c7ced60e584bd18083f740194771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Creating volume 296ab248-f5a6-4871-8335-7b93bbc6ca4d {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:22 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e54f68-be9d-4d11-a7ff-65d7a67508e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de1d173-9531-4131-bdca-ead4b0c19214', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:22 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d 1073741824 Apr 13 17:31:22 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69702155-8849-4459-836e-e0adafffe98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:22 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume volume-7de1d173-9531-4131-bdca-ead4b0c19214 (7de1d173-9531-4131-bdca-ead4b0c19214): created successfully Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69702155-8849-4459-836e-e0adafffe98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Flow 'volume_create_manager' (6013fcec-a551-40fb-abf0-c003ab52bfe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:22 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e9b6c287-7529-4ec7-b7a4-4cbab44bd1c0 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created volume successfully. Apr 13 17:31:22 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27" returned: 0 in 0.587s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-316936a4-ec0e-42b6-bddc-436870b8dc54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9794fd-3f0e-4c28-97ca-0adcb69c00fe]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:22 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:22 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 Apr 13 17:31:22 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:23 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d 1073741824" returned: 0 in 0.667s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:23 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d Apr 13 17:31:23 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:23 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54" returned: 0 in 0.564s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:23 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 Apr 13 17:31:23 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Flow 'volume_create_manager' (af1b216a-0bc3-49c0-908e-5cb49552339d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e029826-f936-49ff-9b24-394fac04350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e029826-f936-49ff-9b24-394fac04350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1506798591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0449da84-ad63-405b-b8a8-0659e6a8e3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b660aaaa9bd4d39b91d69bb2b3943bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:24Z,use_quota=True,user_id='108118652b8945c992962632389e27dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11de260-9c66-4d38-b677-7c7e3370a242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11de260-9c66-4d38-b677-7c7e3370a242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71fd093-ae05-455e-81e0-d898297b6070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71fd093-ae05-455e-81e0-d898297b6070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0449da84-ad63-405b-b8a8-0659e6a8e3de', 'volume_name': 'volume-0449da84-ad63-405b-b8a8-0659e6a8e3de', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15c6425-b39d-45af-80a8-2490e01bd69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15c6425-b39d-45af-80a8-2490e01bd69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db5cacd-a3dc-4d8b-a740-1b9c1b110810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:23 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume 0449da84-ad63-405b-b8a8-0659e6a8e3de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0449da84-ad63-405b-b8a8-0659e6a8e3de', 'volume_size': 1} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:23 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d" returned: 0 in 0.530s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.617s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1440792788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f68c5d-0386-4376-8a65-cec537908857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111248813f44f88bf37ce3bbf7e3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:17Z,use_quota=True,user_id='76c7ced60e584bd18083f740194771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Creating volume 11f68c5d-0386-4376-8a65-cec537908857 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:23 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-11f68c5d-0386-4376-8a65-cec537908857 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e8c47c-f997-45ac-bc5d-c8be3eaf9b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:23 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-11f68c5d-0386-4376-8a65-cec537908857 1073741824 Apr 13 17:31:23 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf77899d-b675-4a18-ba27-24b28ebabef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:23 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d (296ab248-f5a6-4871-8335-7b93bbc6ca4d): created successfully Apr 13 17:31:23 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf77899d-b675-4a18-ba27-24b28ebabef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Flow 'volume_create_manager' (e7f723f7-4113-41b6-995f-beda7ad23f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27" returned: 0 in 0.493s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:23 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:23 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-1b38febe-e2e4-4807-b132-1a0f31ba6510 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created volume successfully. Apr 13 17:31:23 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27 Apr 13 17:31:23 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:24 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54.1960c294-a163-4c75-b855-c8be16bb5b27" returned: 0 in 0.428s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:24 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-11f68c5d-0386-4376-8a65-cec537908857 1073741824" returned: 0 in 0.509s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-1960c294-a163-4c75-b855-c8be16bb5b27" released by "_delete_snapshot" :: held 2.144s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-316936a4-ec0e-42b6-bddc-436870b8dc54" released by "delete_snapshot" :: held 2.161s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-11f68c5d-0386-4376-8a65-cec537908857 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:24 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-11f68c5d-0386-4376-8a65-cec537908857 Apr 13 17:31:24 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Created reservations ['8d2629f2-e560-4b49-a550-833c02c90d40', 'e9fd064b-42e6-4e60-af36-5b9a2f57908e', 'e8cea727-ad0c-4344-9701-c71797276d89', '33aedabd-780d-4d8a-afc0-a7cbfcff7091'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:24 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Delete snapshot completed successfully. Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-377f462e-64f2-4f63-94a0-d0374b8ffb3e tempest-VolumeDependencyTests-946038410 None] Lock "cinder-1960c294-a163-4c75-b855-c8be16bb5b27-delete_snapshot" released by "delete_snapshot" :: held 2.277s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:24 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-11f68c5d-0386-4376-8a65-cec537908857" returned: 0 in 0.448s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.965s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1593240629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111248813f44f88bf37ce3bbf7e3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:18Z,use_quota=True,user_id='76c7ced60e584bd18083f740194771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Creating volume cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:24 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef45de3-bf58-4922-9144-042dd47dc984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f68c5d-0386-4376-8a65-cec537908857', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:24 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1 1073741824 Apr 13 17:31:24 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a11eb02-571b-45eb-8907-d83ebd107056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:24 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume volume-11f68c5d-0386-4376-8a65-cec537908857 (11f68c5d-0386-4376-8a65-cec537908857): created successfully Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a11eb02-571b-45eb-8907-d83ebd107056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:24 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Flow 'volume_create_manager' (cd192666-0856-493b-962f-c9e553097497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:24 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b1c98956-fd80-40d9-a474-07c3b207c960 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created volume successfully. Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-316936a4-ec0e-42b6-bddc-436870b8dc54-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:25 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1 1073741824" returned: 0 in 0.523s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Lock "cinder-316936a4-ec0e-42b6-bddc-436870b8dc54-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-quobyte-316936a4-ec0e-42b6-bddc-436870b8dc54" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-316936a4-ec0e-42b6-bddc-436870b8dc54" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bad3778-0e58-4bd0-af29-6eebc2c01047]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:25 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1 Apr 13 17:31:25 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:25 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 Apr 13 17:31:25 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:25 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1" returned: 0 in 0.464s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.917s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2030679577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e969d2c-a1b4-4371-96f2-4878fbbe0fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111248813f44f88bf37ce3bbf7e3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:18Z,use_quota=True,user_id='76c7ced60e584bd18083f740194771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Creating volume 0e969d2c-a1b4-4371-96f2-4878fbbe0fb3 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:25 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:25 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54" returned: 0 in 0.504s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:25 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3 1073741824 Apr 13 17:31:25 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:25 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07da3e52-7623-4baf-910a-fec7d92bed6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6b89c4-ddd3-4feb-898a-7923ba212d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:26 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54 Apr 13 17:31:26 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:26 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1 (cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1): created successfully Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6b89c4-ddd3-4feb-898a-7923ba212d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Flow 'volume_create_manager' (13945352-42c1-4add-931a-50ae82b2f319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:26 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-42e9cac5-460d-4011-b9c5-edac260db175 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created volume successfully. Apr 13 17:31:26 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-316936a4-ec0e-42b6-bddc-436870b8dc54" returned: 0 in 0.457s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-316936a4-ec0e-42b6-bddc-436870b8dc54" released by "delete_volume" :: held 0.996s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:26 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3 1073741824" returned: 0 in 0.511s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Created reservations ['89e22432-d0d7-475d-bed5-aba07056e06e', 'ac375394-18f9-4ffa-8503-da1dc19186a3', '56319765-eb06-4b82-9bb7-644e35b7210c', '003a206d-12a4-4bc8-8a03-4b0a44f66702'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:26 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3 Apr 13 17:31:26 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:26 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:26 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:26 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3" returned: 0 in 0.439s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.726s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-655263123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faff20da-a136-4c7f-885e-fc3d07261422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a052c97c3d714e54b1642f188e73596c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:18Z,use_quota=True,user_id='a2c99554708349a8809b1217fb695103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Creating volume faff20da-a136-4c7f-885e-fc3d07261422 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:26 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:26 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd00539-c568-4c28-8645-019928b6d22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1d9825-36a0-4152-87ec-b8e2160295ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:27 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 1073741824 Apr 13 17:31:27 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:27 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.471s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:27 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Volume volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3 (0e969d2c-a1b4-4371-96f2-4878fbbe0fb3): created successfully Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1d9825-36a0-4152-87ec-b8e2160295ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Flow 'volume_create_manager' (8123ffd3-729f-455d-9abc-aeaa01150342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:27 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Deleted volume successfully. Apr 13 17:31:27 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f22909b7-4e1e-4f43-9ec9-0aff9b4805a5 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created volume successfully. Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-840ad946-6875-41e6-85d9-602ec982ed3e tempest-VolumeDependencyTests-946038410 None] Lock "cinder-316936a4-ec0e-42b6-bddc-436870b8dc54-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:27 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 1073741824" returned: 0 in 0.505s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:27 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 Apr 13 17:31:27 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Flow 'volume_create_manager' (474cfed6-441f-4748-8a6f-632096974adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38dac92-72f4-4b67-a571-870c66894b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38dac92-72f4-4b67-a571-870c66894b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-160882424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198b864e-704b-4cb7-bb60-433995b80cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322db8b2397d45709f30ab46838a63c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:28Z,use_quota=True,user_id='931ecff4430b41029f82dfeff32b37fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d386fc9-d474-4899-a34f-49194de1d301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d386fc9-d474-4899-a34f-49194de1d301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6665227b-ec1c-430c-accf-d1ef1674dc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6665227b-ec1c-430c-accf-d1ef1674dc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '198b864e-704b-4cb7-bb60-433995b80cf6', 'volume_name': 'volume-198b864e-704b-4cb7-bb60-433995b80cf6', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c01ca84-9aec-4e74-bff0-2d7fbcbfc92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c01ca84-9aec-4e74-bff0-2d7fbcbfc92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe79b5c8-e808-4a4a-894e-aa35f4eab340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:27 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Volume 198b864e-704b-4cb7-bb60-433995b80cf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-198b864e-704b-4cb7-bb60-433995b80cf6', 'volume_size': 1} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:27 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:27 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422" returned: 0 in 0.489s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.322s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1506798591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0449da84-ad63-405b-b8a8-0659e6a8e3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b660aaaa9bd4d39b91d69bb2b3943bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:24Z,use_quota=True,user_id='108118652b8945c992962632389e27dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Creating volume 0449da84-ad63-405b-b8a8-0659e6a8e3de {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:28 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0449da84-ad63-405b-b8a8-0659e6a8e3de 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0958ee54-2668-4817-88a8-2045870103fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faff20da-a136-4c7f-885e-fc3d07261422', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60bad9ef-804f-442f-aa2b-5331fb223e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:28 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0449da84-ad63-405b-b8a8-0659e6a8e3de 1073741824 Apr 13 17:31:28 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:28 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Volume volume-faff20da-a136-4c7f-885e-fc3d07261422 (faff20da-a136-4c7f-885e-fc3d07261422): created successfully Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60bad9ef-804f-442f-aa2b-5331fb223e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Flow 'volume_create_manager' (d0cff3f7-a939-44da-a0c5-6b8aa1a335d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:28 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-e259791c-d9c8-490d-bcdc-8183e4bdb3b1 tempest-SnapshotDependencyTests-327166059 None] Created volume successfully. Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-quobyte-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3" acquired by "delete_volume" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8a095a-7d97-4a81-b997-26639273b22c]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:28 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3 Apr 13 17:31:28 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:28 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0449da84-ad63-405b-b8a8-0659e6a8e3de 1073741824" returned: 0 in 0.511s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0449da84-ad63-405b-b8a8-0659e6a8e3de {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:28 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0449da84-ad63-405b-b8a8-0659e6a8e3de Apr 13 17:31:28 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:28 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3" returned: 0 in 0.524s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:28 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:28 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3 Apr 13 17:31:28 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:29 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0449da84-ad63-405b-b8a8-0659e6a8e3de" returned: 0 in 0.459s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.044s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-160882424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198b864e-704b-4cb7-bb60-433995b80cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322db8b2397d45709f30ab46838a63c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:28Z,use_quota=True,user_id='931ecff4430b41029f82dfeff32b37fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Creating volume 198b864e-704b-4cb7-bb60-433995b80cf6 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:29 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db5cacd-a3dc-4d8b-a740-1b9c1b110810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0449da84-ad63-405b-b8a8-0659e6a8e3de', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63192b29-2109-4d33-b3b5-54e05eb2be4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:29 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 1073741824 Apr 13 17:31:29 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:29 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume volume-0449da84-ad63-405b-b8a8-0659e6a8e3de (0449da84-ad63-405b-b8a8-0659e6a8e3de): created successfully Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63192b29-2109-4d33-b3b5-54e05eb2be4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Flow 'volume_create_manager' (af1b216a-0bc3-49c0-908e-5cb49552339d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:29 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b3181306-7d24-4078-8f6d-3c3f09e847db tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Created volume successfully. Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:29 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3" returned: 0 in 0.555s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3" released by "delete_volume" :: held 1.102s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created reservations ['af0687fc-4185-4ad9-b2ae-f54b7dc015b0', 'd0713acc-711b-40a2-b76c-e09eb2e3220f', 'cb00da93-e7b6-4937-ad18-ddc7aeba212d', '85ccc679-031e-48bb-9b43-80e2f685fbd6'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:29 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:29 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:29 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 1073741824" returned: 0 in 0.539s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:29 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 Apr 13 17:31:29 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:29 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.450s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:29 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Deleted volume successfully. Apr 13 17:31:29 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-930cfa67-4f65-46ea-92a9-872645dbd776 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-0e969d2c-a1b4-4371-96f2-4878fbbe0fb3-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:30 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6" returned: 0 in 0.492s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.979s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe79b5c8-e808-4a4a-894e-aa35f4eab340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-198b864e-704b-4cb7-bb60-433995b80cf6', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8131f210-2e49-4fd6-a755-805553c37f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Volume volume-198b864e-704b-4cb7-bb60-433995b80cf6 (198b864e-704b-4cb7-bb60-433995b80cf6): created successfully Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8131f210-2e49-4fd6-a755-805553c37f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Flow 'volume_create_manager' (474cfed6-441f-4748-8a6f-632096974adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] Creating offline snapshot 5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 of volume faff20da-a136-4c7f-885e-fc3d07261422 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1949e9c1-a83f-450b-84f8-4d876c5318f1]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:30 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d1023ef1-e77a-490d-ad20-cfcebd86cbdc tempest-VolumeDependencyTests-946038410 None] Created volume successfully. Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Flow 'volume_create_manager' (879cc616-c1b4-43eb-b406-a480def6ec36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0f0560-60df-483b-82a5-ab3653e2a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0f0560-60df-483b-82a5-ab3653e2a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1913129535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35f2cd8-1f55-4b8f-808c-be90792f5cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b660aaaa9bd4d39b91d69bb2b3943bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:30Z,use_quota=True,user_id='108118652b8945c992962632389e27dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0fbfdf-dbf3-4d30-b5c0-786fe3920992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 Apr 13 17:31:30 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0fbfdf-dbf3-4d30-b5c0-786fe3920992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d9b807-9b3e-4eb0-8431-371c463d0a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d9b807-9b3e-4eb0-8431-371c463d0a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35f2cd8-1f55-4b8f-808c-be90792f5cf9', 'volume_name': 'volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e1425c-cd3a-4f0d-bd5b-d6220b382e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e1425c-cd3a-4f0d-bd5b-d6220b382e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e920b1cf-df48-47c0-ac8a-35a430779f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume f35f2cd8-1f55-4b8f-808c-be90792f5cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9', 'volume_size': 1} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-quobyte-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a709f1-1dfd-4bd0-97b5-b1ae2df6438d]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:30 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1 Apr 13 17:31:30 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Flow 'volume_create_manager' (7c722309-6779-4583-8e38-0dad5f71fc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc880d2-8fc6-43d7-82ec-14f08ec04969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc880d2-8fc6-43d7-82ec-14f08ec04969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-329614305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8067c8df-ab5b-49d8-9e54-922cfe259fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b660aaaa9bd4d39b91d69bb2b3943bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:30Z,use_quota=True,user_id='108118652b8945c992962632389e27dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904e3152-5664-4347-96a8-d0c53c8d250c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904e3152-5664-4347-96a8-d0c53c8d250c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c64a4d-dd1c-4165-a73b-00f893d6c80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c64a4d-dd1c-4165-a73b-00f893d6c80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8067c8df-ab5b-49d8-9e54-922cfe259fc5', 'volume_name': 'volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d375cc-8afb-482f-8a44-1b130b5c8331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d375cc-8afb-482f-8a44-1b130b5c8331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3289c98-0396-4879-a182-524e0d017943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume 8067c8df-ab5b-49d8-9e54-922cfe259fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5', 'volume_size': 1} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Flow 'volume_create_manager' (5324133a-2bd5-4ee6-877b-60a6a478af56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a595be39-7fcc-421d-b5d2-89a821f868c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a595be39-7fcc-421d-b5d2-89a821f868c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1607955588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da6c324-1836-44a5-8780-529bb54259df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b660aaaa9bd4d39b91d69bb2b3943bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:31Z,use_quota=True,user_id='108118652b8945c992962632389e27dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab7053b-d964-460e-8fc3-fca37286acbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab7053b-d964-460e-8fc3-fca37286acbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc79a74-ec81-4edc-a785-45769a3e6f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc79a74-ec81-4edc-a785-45769a3e6f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da6c324-1836-44a5-8780-529bb54259df', 'volume_name': 'volume-9da6c324-1836-44a5-8780-529bb54259df', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69257a32-5954-4a9f-9846-f7635fa95f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69257a32-5954-4a9f-9846-f7635fa95f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5551701-ae9f-4bc1-8f8c-566a56e59f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume 9da6c324-1836-44a5-8780-529bb54259df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da6c324-1836-44a5-8780-529bb54259df', 'volume_size': 1} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:30 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422" returned: 0 in 0.631s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:30 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 1G Apr 13 17:31:30 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Flow 'volume_create_manager' (0b014646-c149-483a-9081-4572b7aaf1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc7d30d-9e8c-43ce-9368-b2578d369768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc7d30d-9e8c-43ce-9368-b2578d369768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1955672840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a58df9d-1f0e-495d-9de9-8498b16a8286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b660aaaa9bd4d39b91d69bb2b3943bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:31Z,use_quota=True,user_id='108118652b8945c992962632389e27dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dbe1ac4-ac3f-4cd7-950c-ce616032f755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dbe1ac4-ac3f-4cd7-950c-ce616032f755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab49aba-09ca-48d1-b498-306cbab3bd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab49aba-09ca-48d1-b498-306cbab3bd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a58df9d-1f0e-495d-9de9-8498b16a8286', 'volume_name': 'volume-6a58df9d-1f0e-495d-9de9-8498b16a8286', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede6cafe-12bf-4016-9d33-e8744b5c3e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede6cafe-12bf-4016-9d33-e8744b5c3e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc8a67-a147-49f9-8180-4f720cdc9e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:30 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume 6a58df9d-1f0e-495d-9de9-8498b16a8286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a58df9d-1f0e-495d-9de9-8498b16a8286', 'volume_size': 1} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1" returned: 0 in 0.618s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:30 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:31 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1 Apr 13 17:31:31 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Flow 'volume_create_manager' (0a457c88-48f0-4495-97d1-2f680202b66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8cad22-9d1c-4305-a8e6-3a5e4b25d57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8cad22-9d1c-4305-a8e6-3a5e4b25d57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2113078670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3045c8c-dd5b-422f-a430-69d5362eec95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b660aaaa9bd4d39b91d69bb2b3943bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:31Z,use_quota=True,user_id='108118652b8945c992962632389e27dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b837d0d8-83aa-4e08-9ca0-deed664e5b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b837d0d8-83aa-4e08-9ca0-deed664e5b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499dcc4b-9027-4364-8dc1-bae78ff88650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499dcc4b-9027-4364-8dc1-bae78ff88650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3045c8c-dd5b-422f-a430-69d5362eec95', 'volume_name': 'volume-e3045c8c-dd5b-422f-a430-69d5362eec95', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c9fdda-096e-44ac-bbb5-ef3e46a6e293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c9fdda-096e-44ac-bbb5-ef3e46a6e293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628fd99f-b864-406a-99cc-958fe0ec427e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:31 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume e3045c8c-dd5b-422f-a430-69d5362eec95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3045c8c-dd5b-422f-a430-69d5362eec95', 'volume_size': 1} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:31 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 1G" returned: 0 in 0.609s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faff20da-a136-4c7f-885e-fc3d07261422 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:31 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faff20da-a136-4c7f-885e-fc3d07261422 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 Apr 13 17:31:31 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:31 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Flow 'volume_create_manager' (b3a4841d-c7f9-4596-8bda-6fcaca6045f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d47e99-f96a-46a7-ab77-636ee6df9889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1" returned: 0 in 0.537s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d47e99-f96a-46a7-ab77-636ee6df9889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2017773028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84352246-1deb-4bfb-805e-827d4b5407a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322db8b2397d45709f30ab46838a63c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=198b864e-704b-4cb7-bb60-433995b80cf6,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:31Z,use_quota=True,user_id='931ecff4430b41029f82dfeff32b37fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3d8fda-9176-4d77-8988-19395eb5d232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3d8fda-9176-4d77-8988-19395eb5d232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857cfba1-9582-4c27-9498-7927475563b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1" released by "delete_volume" :: held 1.198s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857cfba1-9582-4c27-9498-7927475563b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '84352246-1deb-4bfb-805e-827d4b5407a9', 'volume_name': 'volume-84352246-1deb-4bfb-805e-827d4b5407a9', 'volume_size': 1, 'source_volid': '198b864e-704b-4cb7-bb60-433995b80cf6', 'source_volstatus': 'available'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89ee2c0-da7b-4995-9136-2905b2bfb3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89ee2c0-da7b-4995-9136-2905b2bfb3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49bb9e1-3239-449f-9a87-a59a7455f512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:31 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Volume 84352246-1deb-4bfb-805e-827d4b5407a9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-84352246-1deb-4bfb-805e-827d4b5407a9', 'volume_size': 1, 'source_volid': '198b864e-704b-4cb7-bb60-433995b80cf6', 'source_volstatus': 'available'} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created reservations ['c18da2aa-9cb8-4794-924e-cd7c19ae2c74', '79d1f3df-98c4-4dea-9c78-b3b6b8b1627a', 'e6328cd4-675a-49ca-9a1a-040d039b9f2c', 'e9877907-5c29-4c99-ab20-f090b2110a80'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:31 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:31 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:31 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faff20da-a136-4c7f-885e-fc3d07261422 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7" returned: 0 in 0.462s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:31 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 is being set with open permissions: ugo+rw Apr 13 17:31:31 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:31 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 Apr 13 17:31:31 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:32 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.406s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:32 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Deleted volume successfully. Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3f9b0411-f892-41f7-9d75-b543e013576b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-cfb392ae-fd2f-4dc1-aca0-e5a6fbac83f1-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:32 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7" returned: 0 in 0.434s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:32 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.info Apr 13 17:31:32 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-11f68c5d-0386-4376-8a65-cec537908857-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-11f68c5d-0386-4376-8a65-cec537908857-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-quobyte-11f68c5d-0386-4376-8a65-cec537908857" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-11f68c5d-0386-4376-8a65-cec537908857" acquired by "delete_volume" :: waited 0.007s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[719b3748-7aac-474e-9154-cc24dba63c07]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-11f68c5d-0386-4376-8a65-cec537908857 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:32 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-11f68c5d-0386-4376-8a65-cec537908857 Apr 13 17:31:32 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:32 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.info" returned: 0 in 0.443s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:32 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.info is being set with open permissions: ugo+rw Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:32 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.info Apr 13 17:31:32 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:32 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-11f68c5d-0386-4376-8a65-cec537908857" returned: 0 in 0.519s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:32 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-11f68c5d-0386-4376-8a65-cec537908857 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:32 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-11f68c5d-0386-4376-8a65-cec537908857 Apr 13 17:31:32 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:33 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.info" returned: 0 in 0.440s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.137s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.952s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1913129535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35f2cd8-1f55-4b8f-808c-be90792f5cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b660aaaa9bd4d39b91d69bb2b3943bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:30Z,use_quota=True,user_id='108118652b8945c992962632389e27dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Creating volume f35f2cd8-1f55-4b8f-808c-be90792f5cf9 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:33 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:33 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9 1073741824 Apr 13 17:31:33 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:33 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-58da45af-9950-48f1-823c-79eaccf16668 tempest-SnapshotDependencyTests-327166059 None] Create snapshot completed successfully Apr 13 17:31:33 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-11f68c5d-0386-4376-8a65-cec537908857" returned: 0 in 0.446s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-11f68c5d-0386-4376-8a65-cec537908857" released by "delete_volume" :: held 0.996s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created reservations ['13862022-334a-44dd-a7e7-92939025d8d0', '770b49af-b08f-4fd6-ba17-66fbe7f4d430', '6a042c57-a803-4d27-9338-79d19dfc5d83', '7490190a-47a2-4943-9b24-8430f148a71c'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:33 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:33 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_service.periodic_task [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:33 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:33 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:33 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9 1073741824" returned: 0 in 0.563s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:33 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:33 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9 Apr 13 17:31:33 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:34 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.505s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:34 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Deleted volume successfully. Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-8560cb56-f949-41ce-9132-5ae9818c5e76 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-11f68c5d-0386-4376-8a65-cec537908857-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:34 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.471s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f6cddc4a-76f4-4316-b45c-87c80617aba7 None None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:34 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9" returned: 0 in 0.439s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.738s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-329614305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8067c8df-ab5b-49d8-9e54-922cfe259fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b660aaaa9bd4d39b91d69bb2b3943bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:30Z,use_quota=True,user_id='108118652b8945c992962632389e27dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Creating volume 8067c8df-ab5b-49d8-9e54-922cfe259fc5 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:34 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e920b1cf-df48-47c0-ac8a-35a430779f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:34 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5 1073741824 Apr 13 17:31:34 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9b97d9-535c-4cd7-9d35-1e8a6594fffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:34 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9 (f35f2cd8-1f55-4b8f-808c-be90792f5cf9): created successfully Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9b97d9-535c-4cd7-9d35-1e8a6594fffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Flow 'volume_create_manager' (879cc616-c1b4-43eb-b406-a480def6ec36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:34 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-a133b7ef-97f2-43a8-9d27-c6fd85d36aa7 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Created volume successfully. Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-296ab248-f5a6-4871-8335-7b93bbc6ca4d-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-296ab248-f5a6-4871-8335-7b93bbc6ca4d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-quobyte-296ab248-f5a6-4871-8335-7b93bbc6ca4d" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-296ab248-f5a6-4871-8335-7b93bbc6ca4d" acquired by "delete_volume" :: waited 0.007s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7a1612-9da7-4205-9cc0-f5f5d187f3d0]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:34 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Flow 'volume_create_manager' (ddf9b7c2-834e-4975-9b8f-49ce8f755048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:34 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025da3ef-c8e2-4cfd-954c-4544bb334207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025da3ef-c8e2-4cfd-954c-4544bb334207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1968b611-164e-4a8d-84c7-fa32115ebfc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a052c97c3d714e54b1642f188e73596c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:35Z,use_quota=True,user_id='a2c99554708349a8809b1217fb695103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3433dca5-f3bf-4863-8fb4-131564eba0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3433dca5-f3bf-4863-8fb4-131564eba0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19e1f02-1f33-4c64-8223-2653a3fe5ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19e1f02-1f33-4c64-8223-2653a3fe5ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1968b611-164e-4a8d-84c7-fa32115ebfc5', 'volume_name': 'volume-1968b611-164e-4a8d-84c7-fa32115ebfc5', 'volume_size': 1, 'snapshot_id': '5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b052ee2-bb10-4102-96b6-ae835618d924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b052ee2-bb10-4102-96b6-ae835618d924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89464e67-16fb-414d-bb2f-52cb25c89ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:34 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Volume 1968b611-164e-4a8d-84c7-fa32115ebfc5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1968b611-164e-4a8d-84c7-fa32115ebfc5', 'volume_size': 1, 'snapshot_id': '5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7'} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:34 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5 1073741824" returned: 0 in 0.597s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:34 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:34 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5 Apr 13 17:31:34 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:35 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d" returned: 0 in 0.520s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:35 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d Apr 13 17:31:35 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:35 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5" returned: 0 in 0.466s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.626s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1607955588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da6c324-1836-44a5-8780-529bb54259df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b660aaaa9bd4d39b91d69bb2b3943bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:31Z,use_quota=True,user_id='108118652b8945c992962632389e27dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Creating volume 9da6c324-1836-44a5-8780-529bb54259df {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:35 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9da6c324-1836-44a5-8780-529bb54259df 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3289c98-0396-4879-a182-524e0d017943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b4c289-9860-4d87-89c2-642eaad618bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:35 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9da6c324-1836-44a5-8780-529bb54259df 1073741824 Apr 13 17:31:35 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:35 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5 (8067c8df-ab5b-49d8-9e54-922cfe259fc5): created successfully Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b4c289-9860-4d87-89c2-642eaad618bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Flow 'volume_create_manager' (7c722309-6779-4583-8e38-0dad5f71fc4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:35 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-6ada92d4-d589-4b05-8ea0-8cdc076ab33f tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Created volume successfully. Apr 13 17:31:35 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-296ab248-f5a6-4871-8335-7b93bbc6ca4d" returned: 0 in 0.431s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-296ab248-f5a6-4871-8335-7b93bbc6ca4d" released by "delete_volume" :: held 0.977s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created reservations ['4e801b5b-9969-44c1-ad72-5f4be7f84655', '511b2d6e-358e-4f60-ba51-df323068503e', '84464775-6c78-4a7d-828c-3ea88b7078f1', '29f2681d-672e-42d8-8ca0-325f295bd5d1'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:35 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:35 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:35 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9da6c324-1836-44a5-8780-529bb54259df 1073741824" returned: 0 in 0.538s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:35 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9da6c324-1836-44a5-8780-529bb54259df {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:35 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9da6c324-1836-44a5-8780-529bb54259df Apr 13 17:31:35 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:36 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.468s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:36 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Deleted volume successfully. Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d05b8abf-624e-4373-b9f2-d6483486de84 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-296ab248-f5a6-4871-8335-7b93bbc6ca4d-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:36 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9da6c324-1836-44a5-8780-529bb54259df" returned: 0 in 0.440s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.426s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1955672840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a58df9d-1f0e-495d-9de9-8498b16a8286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b660aaaa9bd4d39b91d69bb2b3943bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:31Z,use_quota=True,user_id='108118652b8945c992962632389e27dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Creating volume 6a58df9d-1f0e-495d-9de9-8498b16a8286 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:36 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6a58df9d-1f0e-495d-9de9-8498b16a8286 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5551701-ae9f-4bc1-8f8c-566a56e59f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da6c324-1836-44a5-8780-529bb54259df', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:36 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6a58df9d-1f0e-495d-9de9-8498b16a8286 1073741824 Apr 13 17:31:36 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b33d6df-a289-4f54-8b2e-ea9fb86873f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:36 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume volume-9da6c324-1836-44a5-8780-529bb54259df (9da6c324-1836-44a5-8780-529bb54259df): created successfully Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b33d6df-a289-4f54-8b2e-ea9fb86873f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Flow 'volume_create_manager' (5324133a-2bd5-4ee6-877b-60a6a478af56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:36 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-705e2022-50b9-4779-a06d-c34f00c000b2 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Created volume successfully. Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-7de1d173-9531-4131-bdca-ead4b0c19214-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-7de1d173-9531-4131-bdca-ead4b0c19214-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-quobyte-7de1d173-9531-4131-bdca-ead4b0c19214" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-7de1d173-9531-4131-bdca-ead4b0c19214" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75ade07-3c55-40d3-8e8b-28ca1f5e3919]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:36 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7de1d173-9531-4131-bdca-ead4b0c19214 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:37 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6a58df9d-1f0e-495d-9de9-8498b16a8286 1073741824" returned: 0 in 0.619s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6a58df9d-1f0e-495d-9de9-8498b16a8286 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:37 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7de1d173-9531-4131-bdca-ead4b0c19214 Apr 13 17:31:37 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:37 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6a58df9d-1f0e-495d-9de9-8498b16a8286 Apr 13 17:31:37 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:37 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6a58df9d-1f0e-495d-9de9-8498b16a8286" returned: 0 in 0.543s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:37 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.348s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2113078670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3045c8c-dd5b-422f-a430-69d5362eec95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b660aaaa9bd4d39b91d69bb2b3943bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:31Z,use_quota=True,user_id='108118652b8945c992962632389e27dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Creating volume e3045c8c-dd5b-422f-a430-69d5362eec95 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:37 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e3045c8c-dd5b-422f-a430-69d5362eec95 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7de1d173-9531-4131-bdca-ead4b0c19214" returned: 0 in 0.639s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7de1d173-9531-4131-bdca-ead4b0c19214 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:37 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e3045c8c-dd5b-422f-a430-69d5362eec95 1073741824 Apr 13 17:31:37 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc8a67-a147-49f9-8180-4f720cdc9e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a58df9d-1f0e-495d-9de9-8498b16a8286', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175ba62c-a820-4bf6-a765-243f3fbb63c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:37 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7de1d173-9531-4131-bdca-ead4b0c19214 Apr 13 17:31:37 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:37 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume volume-6a58df9d-1f0e-495d-9de9-8498b16a8286 (6a58df9d-1f0e-495d-9de9-8498b16a8286): created successfully Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175ba62c-a820-4bf6-a765-243f3fbb63c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:37 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Flow 'volume_create_manager' (0b014646-c149-483a-9081-4572b7aaf1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:37 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-8d9494b3-a359-4ebe-8ae7-742bc251c808 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Created volume successfully. Apr 13 17:31:38 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7de1d173-9531-4131-bdca-ead4b0c19214" returned: 0 in 0.549s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-7de1d173-9531-4131-bdca-ead4b0c19214" released by "delete_volume" :: held 1.214s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:38 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e3045c8c-dd5b-422f-a430-69d5362eec95 1073741824" returned: 0 in 0.584s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e3045c8c-dd5b-422f-a430-69d5362eec95 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created reservations ['6fa6faac-d252-40bb-8252-f34e68946aea', 'f5d4b5b4-3b68-4b9e-b1c1-920b2f45feec', '5958a174-514a-4270-8df6-a29d9518c11a', '38cc5dbf-f15a-4d2f-8d9e-80a2d817c15d'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:38 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e3045c8c-dd5b-422f-a430-69d5362eec95 Apr 13 17:31:38 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:38 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:38 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:38 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e3045c8c-dd5b-422f-a430-69d5362eec95" returned: 0 in 0.531s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.187s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:38 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Cloning volume 198b864e-704b-4cb7-bb60-433995b80cf6 to volume 84352246-1deb-4bfb-805e-827d4b5407a9 Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628fd99f-b864-406a-99cc-958fe0ec427e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3045c8c-dd5b-422f-a430-69d5362eec95', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b41111-d5b7-46cf-9cfb-6ef1efe9c33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:38 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:38 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Volume volume-e3045c8c-dd5b-422f-a430-69d5362eec95 (e3045c8c-dd5b-422f-a430-69d5362eec95): created successfully Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b41111-d5b7-46cf-9cfb-6ef1efe9c33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Flow 'volume_create_manager' (0a457c88-48f0-4495-97d1-2f680202b66c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.512s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Creating offline snapshot 202c7d7c-9559-4c87-a89e-7ea386e95825 of volume 198b864e-704b-4cb7-bb60-433995b80cf6 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:38 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Deleted volume successfully. Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[06683758-29ba-4fc6-94ca-3615950948e7]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:38 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-171c9b7c-f888-408f-be9f-c5051fcbf7df tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Created volume successfully. Apr 13 17:31:38 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d5ca1dfc-29a6-455a-9235-7296eef63f83 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-7de1d173-9531-4131-bdca-ead4b0c19214-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:38 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 Apr 13 17:31:38 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-fed01d04-24a4-414f-bafc-12332aeb4b57-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-fed01d04-24a4-414f-bafc-12332aeb4b57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-quobyte-e34364a3-53e0-4dc9-abf0-6b3aadd9badc" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-e34364a3-53e0-4dc9-abf0-6b3aadd9badc" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-quobyte-fed01d04-24a4-414f-bafc-12332aeb4b57" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-fed01d04-24a4-414f-bafc-12332aeb4b57" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Deleting offline snapshot fed01d04-24a4-414f-bafc-12332aeb4b57 of volume e34364a3-53e0-4dc9-abf0-6b3aadd9badc {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] snapshot_file for this snap is: volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[35db02d1-eddf-44b8-9940-5649a9c56bb0]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:39 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 Apr 13 17:31:39 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:39 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6" returned: 0 in 0.556s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:39 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 1G Apr 13 17:31:39 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:39 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57" returned: 0 in 0.566s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c41098-d36b-4e02-9cc8-559da70f2f66]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "cinder-e3045c8c-dd5b-422f-a430-69d5362eec95-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-e3045c8c-dd5b-422f-a430-69d5362eec95-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:39 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc Apr 13 17:31:39 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "cinder-quobyte-e3045c8c-dd5b-422f-a430-69d5362eec95" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-quobyte-e3045c8c-dd5b-422f-a430-69d5362eec95" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5c9a3e-72d0-439f-a78c-feec7a736b69]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:39 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e3045c8c-dd5b-422f-a430-69d5362eec95 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:40 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e3045c8c-dd5b-422f-a430-69d5362eec95 Apr 13 17:31:40 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:40 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 1G" returned: 0 in 0.621s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198b864e-704b-4cb7-bb60-433995b80cf6 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:40 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198b864e-704b-4cb7-bb60-433995b80cf6 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 Apr 13 17:31:40 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:40 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc" returned: 0 in 0.564s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:40 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 Apr 13 17:31:40 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:40 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e3045c8c-dd5b-422f-a430-69d5362eec95" returned: 0 in 0.572s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e3045c8c-dd5b-422f-a430-69d5362eec95 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:40 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e3045c8c-dd5b-422f-a430-69d5362eec95 Apr 13 17:31:40 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:40 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198b864e-704b-4cb7-bb60-433995b80cf6 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825" returned: 0 in 0.479s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:40 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 is being set with open permissions: ugo+rw Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:40 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 Apr 13 17:31:40 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:40 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57" returned: 0 in 0.517s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:40 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57 Apr 13 17:31:40 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:40 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e3045c8c-dd5b-422f-a430-69d5362eec95" returned: 0 in 0.504s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-quobyte-e3045c8c-dd5b-422f-a430-69d5362eec95" released by "delete_volume" :: held 1.101s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:40 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825" returned: 0 in 0.468s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:40 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:41 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.info Apr 13 17:31:41 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Created reservations ['9426bf2c-73df-4253-aa7f-81cb770bd6e1', 'a41660e5-37d5-4c28-ab9a-f20f33e94cd2', 'd658ec55-6559-4f7a-a703-47271323b4e6', 'bdd69277-9900-4865-bcf5-84db7b3db646'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:41 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:41 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:41 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc.fed01d04-24a4-414f-bafc-12332aeb4b57" returned: 0 in 0.452s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-fed01d04-24a4-414f-bafc-12332aeb4b57" released by "_delete_snapshot" :: held 2.169s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-e34364a3-53e0-4dc9-abf0-6b3aadd9badc" released by "delete_snapshot" :: held 2.185s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created reservations ['99e2bd31-1ee6-4887-98a3-8f81237b95c1', 'dc8816f0-a807-4f8e-b6cc-cb347225c96c', '88a5226e-9753-4ff2-97e1-323d220db51a', '6b20745f-ac55-4965-8c79-94e13b0f73a6'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:41 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Delete snapshot completed successfully. Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-321ee84e-ca9b-4349-a583-81bc2cf9037b tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-fed01d04-24a4-414f-bafc-12332aeb4b57-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:41 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.info" returned: 0 in 0.430s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:41 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.info is being set with open permissions: ugo+rw Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:41 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.info Apr 13 17:31:41 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:41 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.456s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:41 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Deleted volume successfully. Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-841d9a85-8f76-42fa-9a6a-1fea6c809901 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-e3045c8c-dd5b-422f-a430-69d5362eec95-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:41 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.info" returned: 0 in 0.418s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-quobyte-84352246-1deb-4bfb-805e-827d4b5407a9" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-84352246-1deb-4bfb-805e-827d4b5407a9" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] snapshot: 202c7d7c-9559-4c87-a89e-7ea386e95825, volume: 84352246-1deb-4bfb-805e-827d4b5407a9, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9b3fd6-71ad-4ef0-bead-d66ccdc45146]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:41 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 Apr 13 17:31:41 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "cinder-6a58df9d-1f0e-495d-9de9-8498b16a8286-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:41 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-6a58df9d-1f0e-495d-9de9-8498b16a8286-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "cinder-quobyte-6a58df9d-1f0e-495d-9de9-8498b16a8286" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-quobyte-6a58df9d-1f0e-495d-9de9-8498b16a8286" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa5add9-e4aa-4d7a-abdb-150e68822543]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6a58df9d-1f0e-495d-9de9-8498b16a8286 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:42 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6a58df9d-1f0e-495d-9de9-8498b16a8286 Apr 13 17:31:42 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-e34364a3-53e0-4dc9-abf0-6b3aadd9badc-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-e34364a3-53e0-4dc9-abf0-6b3aadd9badc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "cinder-quobyte-e34364a3-53e0-4dc9-abf0-6b3aadd9badc" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-e34364a3-53e0-4dc9-abf0-6b3aadd9badc" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4fac2a-3b57-4ffc-bba5-83ec122d3c0a]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:42 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc Apr 13 17:31:42 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:42 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825" returned: 0 in 0.537s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198b864e-704b-4cb7-bb60-433995b80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[84369066-5e08-4235-a6f0-efe86daa1423]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:42 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 Apr 13 17:31:42 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:42 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6a58df9d-1f0e-495d-9de9-8498b16a8286" returned: 0 in 0.534s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6a58df9d-1f0e-495d-9de9-8498b16a8286 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:42 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6a58df9d-1f0e-495d-9de9-8498b16a8286 Apr 13 17:31:42 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:42 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc" returned: 0 in 0.506s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:42 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc Apr 13 17:31:42 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:42 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6" returned: 0 in 0.512s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9 not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:31:42 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:42 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9 Apr 13 17:31:42 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:43 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-6a58df9d-1f0e-495d-9de9-8498b16a8286" returned: 0 in 0.440s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-quobyte-6a58df9d-1f0e-495d-9de9-8498b16a8286" released by "delete_volume" :: held 1.012s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Created reservations ['4d530fdf-5e4b-4c2e-a801-2f29c2e5798a', 'd1885cfe-f5b8-4d47-b670-53491215ac05', '856e90c3-f4f7-45ca-901e-2c6db74c4fe7', '4f06e7a4-a26f-4e3e-86c8-903aa2d1027c'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:43 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:43 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:43 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e34364a3-53e0-4dc9-abf0-6b3aadd9badc" returned: 0 in 0.525s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-quobyte-e34364a3-53e0-4dc9-abf0-6b3aadd9badc" released by "delete_volume" :: held 1.065s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Created reservations ['a70698ac-f183-42a6-8a2f-44df308397e9', 'c1545cbd-6607-4364-9c36-70b3d84f69a2', 'd23967a7-7e98-494e-acb6-aa04ac702579', '6f6dc5b4-7cc3-4edf-b5b0-139aa3090afa'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:43 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:43 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:43 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:44 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 1.072s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:44 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:44 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Deleted volume successfully. Apr 13 17:31:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-909c0356-fa70-4ee9-9a69-08aced4c6457 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-6a58df9d-1f0e-495d-9de9-8498b16a8286-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "cinder-9da6c324-1836-44a5-8780-529bb54259df-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-9da6c324-1836-44a5-8780-529bb54259df-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "cinder-quobyte-9da6c324-1836-44a5-8780-529bb54259df" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:44 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-quobyte-9da6c324-1836-44a5-8780-529bb54259df" acquired by "delete_volume" :: waited 0.026s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:44 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0fafc6-d34e-40bf-b986-b803caa851a5]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:44 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9da6c324-1836-44a5-8780-529bb54259df {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:44 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9da6c324-1836-44a5-8780-529bb54259df Apr 13 17:31:44 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:45 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9" returned: 0 in 2.457s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:45 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2fa6f4-7bff-47e8-b9fa-08d40a293a6d]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:45 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 2.008s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:45 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:45 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Deleted volume successfully. Apr 13 17:31:45 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 Apr 13 17:31:45 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:45 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-228ed113-cda1-487f-bdb3-682d4df1e818 tempest-CreateVolumesFromSnapshotTest-1269186353 None] Lock "cinder-e34364a3-53e0-4dc9-abf0-6b3aadd9badc-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:45 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9da6c324-1836-44a5-8780-529bb54259df" returned: 0 in 1.173s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:45 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9da6c324-1836-44a5-8780-529bb54259df {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:45 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9da6c324-1836-44a5-8780-529bb54259df Apr 13 17:31:45 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:46 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6" returned: 0 in 0.802s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9 {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:31:46 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Converted 1024.00 MB image at 416.44 MB/s Apr 13 17:31:46 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9 is being set with open permissions: ugo+rw Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:46 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9 Apr 13 17:31:46 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:46 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-9da6c324-1836-44a5-8780-529bb54259df" returned: 0 in 0.577s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-quobyte-9da6c324-1836-44a5-8780-529bb54259df" released by "delete_volume" :: held 1.800s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Created reservations ['43038c54-cb41-4faf-8822-fceb88fba6ee', 'de6c547b-e78f-4c78-ae61-703e90e19c65', '3ddc72c5-b35a-47d0-96a4-750a56058336', '7836ebf2-d4c3-4220-adbe-75bb24977054'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=158,cinder:UPDATE=211,cinder:INSERT=58,cinder:DELETE=28 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:46 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:46 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:46 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9" returned: 0 in 0.546s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-84352246-1deb-4bfb-805e-827d4b5407a9" released by "_copy_volume_from_snapshot" :: held 4.908s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-quobyte-202c7d7c-9559-4c87-a89e-7ea386e95825" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-202c7d7c-9559-4c87-a89e-7ea386e95825" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Deleting offline snapshot 202c7d7c-9559-4c87-a89e-7ea386e95825 of volume 198b864e-704b-4cb7-bb60-433995b80cf6 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] snapshot_file for this snap is: volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782f07f-dbd6-44e6-a388-0d906350bbc2]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "cinder-8067c8df-ab5b-49d8-9e54-922cfe259fc5-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:46 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 Apr 13 17:31:46 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-8067c8df-ab5b-49d8-9e54-922cfe259fc5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "cinder-quobyte-8067c8df-ab5b-49d8-9e54-922cfe259fc5" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-quobyte-8067c8df-ab5b-49d8-9e54-922cfe259fc5" acquired by "delete_volume" :: waited 0.018s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5453785-9c5b-40d8-bcb5-04ba1c6c3071]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:46 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.571s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:46 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:46 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Deleted volume successfully. Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-03388cd9-56f9-4ae3-8dc7-d198d8c7a0a5 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-9da6c324-1836-44a5-8780-529bb54259df-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:47 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5 Apr 13 17:31:47 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Flow 'volume_create_manager' (301a7576-4a45-4c56-8cff-b9fc6255d4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5a756b-5f6d-4137-a81b-1cf8085e7870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5a756b-5f6d-4137-a81b-1cf8085e7870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1065f22-1ff4-478a-a306-02138231c098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3a93ee580e446d812dd97abe702bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:47Z,use_quota=True,user_id='f0944aff34f74d8a957528359a70fe38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e85035-023a-4ad2-ad8b-1a07b133e489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e85035-023a-4ad2-ad8b-1a07b133e489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0862013c-cdfa-4f15-a03f-ac65cb897be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0862013c-cdfa-4f15-a03f-ac65cb897be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1065f22-1ff4-478a-a306-02138231c098', 'volume_name': 'volume-e1065f22-1ff4-478a-a306-02138231c098', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a58897e-e309-4306-aa15-2f520a41baa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a58897e-e309-4306-aa15-2f520a41baa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3fd8c2-2c18-405d-a0c9-a598a41e2caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:47 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Volume e1065f22-1ff4-478a-a306-02138231c098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1065f22-1ff4-478a-a306-02138231c098', 'volume_size': 1} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:47 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825" returned: 0 in 0.587s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198b864e-704b-4cb7-bb60-433995b80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8330adf2-6fbe-4d09-acf4-2c08599cbfeb]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:47 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 Apr 13 17:31:47 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:47 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5" returned: 0 in 0.559s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:47 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5 Apr 13 17:31:47 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:47 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6" returned: 0 in 0.520s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:47 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 Apr 13 17:31:47 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:47 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-8067c8df-ab5b-49d8-9e54-922cfe259fc5" returned: 0 in 0.430s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:47 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-quobyte-8067c8df-ab5b-49d8-9e54-922cfe259fc5" released by "delete_volume" :: held 1.021s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Created reservations ['8507be75-0541-4517-9472-eedf37f3cde5', '786b973c-c3e2-46b1-94e3-611bdf6cbdee', '8b8bf0c0-802d-443c-b674-09371695e324', 'bb37db81-9c69-4721-91c8-157b6fd9cd03'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:48 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:48 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:48 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825" returned: 0 in 0.502s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:48 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825 Apr 13 17:31:48 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:48 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.436s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:48 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Deleted volume successfully. Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-b8e7fa9a-aede-4b98-87cc-ebc21653744d tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-8067c8df-ab5b-49d8-9e54-922cfe259fc5-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:48 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6.202c7d7c-9559-4c87-a89e-7ea386e95825" returned: 0 in 0.453s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-202c7d7c-9559-4c87-a89e-7ea386e95825" released by "_delete_snapshot" :: held 2.111s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.155s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 14.119s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "cinder-quobyte-5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7-1968b611-164e-4a8d-84c7-fa32115ebfc5" by "_create_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49bb9e1-3239-449f-9a87-a59a7455f512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84352246-1deb-4bfb-805e-827d4b5407a9', 'volume_size': 1, 'source_volid': '198b864e-704b-4cb7-bb60-433995b80cf6', 'source_volstatus': 'available'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb65e3b-86a0-4655-9945-b353fce21614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-quobyte-5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7-1968b611-164e-4a8d-84c7-fa32115ebfc5" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Creating volume 1968b611-164e-4a8d-84c7-fa32115ebfc5 from snapshot 5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 {{(pid=81998) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "cinder-quobyte-1968b611-164e-4a8d-84c7-fa32115ebfc5" by "_copy_volume_from_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:48 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Volume volume-84352246-1deb-4bfb-805e-827d4b5407a9 (84352246-1deb-4bfb-805e-827d4b5407a9): created successfully Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb65e3b-86a0-4655-9945-b353fce21614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Flow 'volume_create_manager' (b3a4841d-c7f9-4596-8bda-6fcaca6045f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-quobyte-1968b611-164e-4a8d-84c7-fa32115ebfc5" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] snapshot: 5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7, volume: 1968b611-164e-4a8d-84c7-fa32115ebfc5, {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:48 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacd4444-ff16-40fa-8a4d-937254c2c380]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:49 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-efb68199-109f-4166-9bf3-532ed2b1e1a2 tempest-VolumeDependencyTests-946038410 None] Created volume successfully. Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "cinder-f35f2cd8-1f55-4b8f-808c-be90792f5cf9-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-f35f2cd8-1f55-4b8f-808c-be90792f5cf9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "cinder-quobyte-f35f2cd8-1f55-4b8f-808c-be90792f5cf9" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:49 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 Apr 13 17:31:49 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-quobyte-f35f2cd8-1f55-4b8f-808c-be90792f5cf9" acquired by "delete_volume" :: waited 0.007s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8a6860-b9fe-4076-8b13-7be3c1ff75dd]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:49 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9 Apr 13 17:31:49 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:49 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7" returned: 0 in 0.548s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faff20da-a136-4c7f-885e-fc3d07261422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] will copy from snapshot at /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Creating direct copy from snapshot {{(pid=81998) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1d8a5e-6a16-474b-aeea-6b583e459b26]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:49 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 Apr 13 17:31:49 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-198b864e-704b-4cb7-bb60-433995b80cf6-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Lock "cinder-198b864e-704b-4cb7-bb60-433995b80cf6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:49 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9" returned: 0 in 0.601s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:49 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9 Apr 13 17:31:49 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-quobyte-198b864e-704b-4cb7-bb60-433995b80cf6" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-198b864e-704b-4cb7-bb60-433995b80cf6" acquired by "delete_volume" :: waited 0.012s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3752c8fd-88cc-4e0c-afe0-e611fe92a18d]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:49 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:49 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 Apr 13 17:31:49 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:50 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422" returned: 0 in 0.558s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG cinder.utils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Path /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5 not found in is_blk_device check {{(pid=81998) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:50 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5 Apr 13 17:31:50 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:50 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-f35f2cd8-1f55-4b8f-808c-be90792f5cf9" returned: 0 in 0.512s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-quobyte-f35f2cd8-1f55-4b8f-808c-be90792f5cf9" released by "delete_volume" :: held 1.136s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Created reservations ['e0cd1405-793b-4b35-a151-d3db4f5a06a4', '1d1f7bc3-90f8-462a-afc2-bf5f615a4ee8', '0e214db3-4090-4393-a14e-6c29f25bd001', '2e7b7945-e7df-4a76-b943-d34768625dee'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:50 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6" returned: 0 in 0.540s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:50 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:50 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:50 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:50 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6 Apr 13 17:31:50 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:51 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-198b864e-704b-4cb7-bb60-433995b80cf6" returned: 0 in 0.864s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-198b864e-704b-4cb7-bb60-433995b80cf6" released by "delete_volume" :: held 1.453s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:51 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.998s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:51 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Deleted volume successfully. Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "cinder-0449da84-ad63-405b-b8a8-0659e6a8e3de-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Created reservations ['2d9484e8-a4f1-4db5-a920-02dbf684da44', '8f8301da-f4c6-4cf9-a234-53c560dc5a1c', 'f1aab97f-fab9-4e08-9014-618dd70ab90a', '9af9409c-e683-4256-876c-bfecd6fa1d4f'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-5daca9a1-c89c-43e6-896f-e79d7ce7bddc tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-f35f2cd8-1f55-4b8f-808c-be90792f5cf9-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-0449da84-ad63-405b-b8a8-0659e6a8e3de-delete_volume" acquired by "delete_volume" :: waited 0.217s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "cinder-quobyte-0449da84-ad63-405b-b8a8-0659e6a8e3de" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-quobyte-0449da84-ad63-405b-b8a8-0659e6a8e3de" acquired by "delete_volume" :: waited 0.070s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:51 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:51 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc1d7f3-d39d-45c3-a477-b6e74771a192]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:51 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0449da84-ad63-405b-b8a8-0659e6a8e3de {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-84352246-1deb-4bfb-805e-827d4b5407a9-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Lock "cinder-84352246-1deb-4bfb-805e-827d4b5407a9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:52 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0449da84-ad63-405b-b8a8-0659e6a8e3de Apr 13 17:31:52 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-quobyte-84352246-1deb-4bfb-805e-827d4b5407a9" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-84352246-1deb-4bfb-805e-827d4b5407a9" acquired by "delete_volume" :: waited 0.065s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5308d9f9-cc61-4e35-8947-cc3919939696]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:52 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9 Apr 13 17:31:52 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:52 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5" returned: 0 in 2.506s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0e0336-e442-4845-93eb-5c656ab53e92]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:52 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 Apr 13 17:31:52 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:52 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.925s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:52 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Deleted volume successfully. Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-bc43c110-26e0-4778-b8ee-0fdddd4d045d tempest-VolumeDependencyTests-946038410 None] Lock "cinder-198b864e-704b-4cb7-bb60-433995b80cf6-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:52 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0449da84-ad63-405b-b8a8-0659e6a8e3de" returned: 0 in 0.949s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:52 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0449da84-ad63-405b-b8a8-0659e6a8e3de {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:52 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0449da84-ad63-405b-b8a8-0659e6a8e3de Apr 13 17:31:52 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:53 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9" returned: 0 in 0.570s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:53 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9 Apr 13 17:31:53 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:53 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-0449da84-ad63-405b-b8a8-0659e6a8e3de" returned: 0 in 0.421s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-quobyte-0449da84-ad63-405b-b8a8-0659e6a8e3de" released by "delete_volume" :: held 1.447s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Created reservations ['ff6b7f52-c1fa-47ed-9ebd-f56b584f2039', 'a11a548c-fb0d-4914-87a0-8a22aebf1e4a', 'b285d348-45f0-462b-bbeb-821e27b4ffc5', '92c61e81-fa2a-45c7-bcf6-c1575b1e9a81'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:53 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422" returned: 0 in 0.722s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.image.image_utils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Image conversion details: src /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5 {{(pid=81998) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:31:53 devstack cinder-volume[81998]: INFO cinder.image.image_utils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Converted 1024.00 MB image at 408.48 MB/s Apr 13 17:31:53 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5 is being set with open permissions: ugo+rw Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:53 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5 Apr 13 17:31:53 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:53 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:53 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:53 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-84352246-1deb-4bfb-805e-827d4b5407a9" returned: 0 in 0.490s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-84352246-1deb-4bfb-805e-827d4b5407a9" released by "delete_volume" :: held 1.093s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Created reservations ['1eb648bd-c90d-4056-a23d-5d811e286470', 'd9aca2bf-f763-4be9-8f03-c69c843dbbe7', 'dd099dca-5171-4152-be56-5f569e3ab42f', '3bb967ce-aa7e-41e2-b689-8d0b845053b7'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:SELECT=181,cinder:INSERT=51,cinder:UPDATE=256,cinder:DELETE=14 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:53 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:53 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:53 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.485s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:53 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Deleted volume successfully. Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-948d3d8d-a0ed-462d-820c-0de937ac6084 tempest-CreateVolumesFromSourceVolumeTest-1538506133 None] Lock "cinder-0449da84-ad63-405b-b8a8-0659e6a8e3de-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:53 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5" returned: 0 in 0.561s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-quobyte-1968b611-164e-4a8d-84c7-fa32115ebfc5" released by "_copy_volume_from_snapshot" :: held 4.962s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-quobyte-5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7-1968b611-164e-4a8d-84c7-fa32115ebfc5" released by "_create_volume_from_snapshot" :: held 4.991s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.014s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.679s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1065f22-1ff4-478a-a306-02138231c098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3a93ee580e446d812dd97abe702bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:47Z,use_quota=True,user_id='f0944aff34f74d8a957528359a70fe38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Creating volume e1065f22-1ff4-478a-a306-02138231c098 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:53 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:53 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e1065f22-1ff4-478a-a306-02138231c098 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:53 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e1065f22-1ff4-478a-a306-02138231c098 1073741824 Apr 13 17:31:53 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89464e67-16fb-414d-bb2f-52cb25c89ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1968b611-164e-4a8d-84c7-fa32115ebfc5', 'volume_size': 1, 'snapshot_id': '5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7'}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dff3e6c-5eee-4343-85dc-420cea9a4980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:54 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Volume volume-1968b611-164e-4a8d-84c7-fa32115ebfc5 (1968b611-164e-4a8d-84c7-fa32115ebfc5): created successfully Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dff3e6c-5eee-4343-85dc-420cea9a4980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Flow 'volume_create_manager' (ddf9b7c2-834e-4975-9b8f-49ce8f755048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:54 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-83cc6649-43e1-4368-ab29-c01f2f43ff66 tempest-SnapshotDependencyTests-327166059 None] Created volume successfully. Apr 13 17:31:54 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.498s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:54 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Deleted volume successfully. Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-3b9074ab-dcd6-483f-bf71-5841057cd68c tempest-VolumeDependencyTests-946038410 None] Lock "cinder-84352246-1deb-4bfb-805e-827d4b5407a9-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:54 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e1065f22-1ff4-478a-a306-02138231c098 1073741824" returned: 0 in 0.639s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-7590b1c0-80d1-4e92-96f2-9b0defe86418-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e1065f22-1ff4-478a-a306-02138231c098 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Lock "cinder-7590b1c0-80d1-4e92-96f2-9b0defe86418-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:54 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e1065f22-1ff4-478a-a306-02138231c098 Apr 13 17:31:54 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "cinder-quobyte-7590b1c0-80d1-4e92-96f2-9b0defe86418" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-7590b1c0-80d1-4e92-96f2-9b0defe86418" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9887d9a2-73ea-459e-9a7e-aa4ca19a697e]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:54 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:54 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418 Apr 13 17:31:54 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:55 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e1065f22-1ff4-478a-a306-02138231c098" returned: 0 in 0.523s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3fd8c2-2c18-405d-a0c9-a598a41e2caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1065f22-1ff4-478a-a306-02138231c098', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5328af4-1877-47aa-84cf-c1ba3d5f477c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:55 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Volume volume-e1065f22-1ff4-478a-a306-02138231c098 (e1065f22-1ff4-478a-a306-02138231c098): created successfully Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5328af4-1877-47aa-84cf-c1ba3d5f477c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Flow 'volume_create_manager' (301a7576-4a45-4c56-8cff-b9fc6255d4eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:55 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-db1d53b5-3854-4144-873a-5adbceb02e99 tempest-CinderUnicodeTest-1082838149 None] Created volume successfully. Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "cinder-5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "cinder-quobyte-faff20da-a136-4c7f-885e-fc3d07261422" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-quobyte-faff20da-a136-4c7f-885e-fc3d07261422" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "cinder-quobyte-5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-quobyte-5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Deleting offline snapshot 5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 of volume faff20da-a136-4c7f-885e-fc3d07261422 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] snapshot_file for this snap is: volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cf958e-48c1-47f2-ab9c-fb3b20bf4fce]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:55 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418" returned: 0 in 0.608s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:55 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 Apr 13 17:31:55 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:55 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418 Apr 13 17:31:55 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:55 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-7590b1c0-80d1-4e92-96f2-9b0defe86418" returned: 0 in 0.490s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:55 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Lock "cinder-quobyte-7590b1c0-80d1-4e92-96f2-9b0defe86418" released by "delete_volume" :: held 1.136s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7" returned: 0 in 0.574s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faff20da-a136-4c7f-885e-fc3d07261422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47240d9-1842-4f6b-ae69-d3514007c1d4]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Created reservations ['113b67c9-5e99-48fd-a1d4-057def8862e7', 'ffd3cdf1-e201-4f7b-bd6f-18375270c3f5', '2243397f-87f8-4bde-bea2-55cba45a0c41', 'f3b50dac-73ff-4e47-9bfa-cf0ca463302d'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:55 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 Apr 13 17:31:55 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:55 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:55 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:55 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81998) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Flow 'volume_create_manager' (5d1f405e-d875-43a7-be77-23625c234619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9761d4bc-1af6-48d0-9ff2-f57593c44eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9761d4bc-1af6-48d0-9ff2-f57593c44eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1640909342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b12494-27e6-471c-bd48-1394d292e391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3a93ee580e446d812dd97abe702bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:56Z,use_quota=True,user_id='f0944aff34f74d8a957528359a70fe38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b7a482-d61c-4567-bbd1-b4b056432530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b7a482-d61c-4567-bbd1-b4b056432530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013a2b20-09cb-478d-b35f-baae66b8c791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013a2b20-09cb-478d-b35f-baae66b8c791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95b12494-27e6-471c-bd48-1394d292e391', 'volume_name': 'volume-95b12494-27e6-471c-bd48-1394d292e391', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039fd4d7-13fa-45ee-b7b8-7f47d768790f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039fd4d7-13fa-45ee-b7b8-7f47d768790f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd20bcb7-f653-4525-af88-70fe08196aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:56 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Volume 95b12494-27e6-471c-bd48-1394d292e391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95b12494-27e6-471c-bd48-1394d292e391', 'volume_size': 1} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:31:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1640909342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b12494-27e6-471c-bd48-1394d292e391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3a93ee580e446d812dd97abe702bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:31:56Z,use_quota=True,user_id='f0944aff34f74d8a957528359a70fe38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dc4a522-a5f8-4687-a931-8f03baa3f1a8),volume_type_id=4dc4a522-a5f8-4687-a931-8f03baa3f1a8)}" {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Creating volume 95b12494-27e6-471c-bd48-1394d292e391 {{(pid=81998) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Selected osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 as target Quobyte volume. {{(pid=81998) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:31:56 devstack cinder-volume[81998]: INFO cinder.volume.drivers.remotefs [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] casted to osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6 Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 1073741824 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:56 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 1073741824 Apr 13 17:31:56 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:56 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.453s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:31:56 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Deleted volume successfully. Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-c0952faa-b4eb-4428-8232-948ee1b9fde0 tempest-VolumeDependencyTests-946038410 None] Lock "cinder-7590b1c0-80d1-4e92-96f2-9b0defe86418-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:56 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422" returned: 0 in 0.610s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:56 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 Apr 13 17:31:56 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:56 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 1073741824" returned: 0 in 0.633s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:56 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 Apr 13 17:31:56 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:56 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7" returned: 0 in 0.490s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:56 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:56 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7 Apr 13 17:31:56 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:57 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391" returned: 0 in 0.542s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:57 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'} {{(pid=81998) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:31:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd20bcb7-f653-4525-af88-70fe08196aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b12494-27e6-471c-bd48-1394d292e391', 'volume_size': 1}' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403935d0-aaf6-4860-9519-d86a67300f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:31:57 devstack cinder-volume[81998]: INFO cinder.volume.flows.manager.create_volume [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Volume volume-95b12494-27e6-471c-bd48-1394d292e391 (95b12494-27e6-471c-bd48-1394d292e391): created successfully Apr 13 17:31:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403935d0-aaf6-4860-9519-d86a67300f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81998) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:31:57 devstack cinder-volume[81998]: DEBUG cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Flow 'volume_create_manager' (5d1f405e-d875-43a7-be77-23625c234619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81998) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:31:57 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f1b9e4de-7ea6-41e7-bae8-760590d4f00b tempest-CinderUnicodeTest-1082838149 None] Created volume successfully. Apr 13 17:31:57 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:57 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422.5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7" returned: 0 in 0.542s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-quobyte-5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7" released by "_delete_snapshot" :: held 2.284s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-quobyte-faff20da-a136-4c7f-885e-fc3d07261422" released by "delete_snapshot" :: held 2.302s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:57 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Created reservations ['b79add1c-76fc-4b25-9eff-d28409d0072c', 'b55ec28a-863f-47be-9f32-fe7d21089b21', '9b41a106-6dea-4bb3-ba7c-d01331fe0ba1', 'e3914c2f-456f-45d3-8685-1d7ecff5f2f4'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:57 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Delete snapshot completed successfully. Apr 13 17:31:57 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f6e8031a-dc33-44b9-9a39-73557706e6b2 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-5fcd9b04-2e6c-49e6-b1bd-16227bf0f4a7-delete_snapshot" released by "delete_snapshot" :: held 2.409s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "cinder-faff20da-a136-4c7f-885e-fc3d07261422-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-faff20da-a136-4c7f-885e-fc3d07261422-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "cinder-quobyte-faff20da-a136-4c7f-885e-fc3d07261422" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-quobyte-faff20da-a136-4c7f-885e-fc3d07261422" acquired by "delete_volume" :: waited 0.013s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2f8022-b40d-4158-b4c0-280ca032c458]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] Creating offline snapshot a3603d80-b763-42d3-a8c3-20b5b4d57733 of volume 95b12494-27e6-471c-bd48-1394d292e391 {{(pid=81998) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6024c5-d7f2-4d77-8a0b-456bbeb3d601]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:58 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 Apr 13 17:31:58 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:58 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 Apr 13 17:31:58 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:58 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422" returned: 0 in 0.480s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:58 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:59 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422 Apr 13 17:31:59 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:59 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391" returned: 0 in 0.493s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 1G {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:59 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 1G Apr 13 17:31:59 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:59 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-faff20da-a136-4c7f-885e-fc3d07261422" returned: 0 in 0.463s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-quobyte-faff20da-a136-4c7f-885e-fc3d07261422" released by "delete_volume" :: held 0.979s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Created reservations ['b9e4ec6a-2bcb-44c0-9bd8-3f29b4448eac', 'c4308435-aee4-418a-8428-abf75780fc13', '4400a6b6-8f0d-4ece-9232-63ba84137ddc', 'a3e65ade-c958-4217-b976-a7b1b9f79b16'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:59 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:31:59 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:31:59 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 1G" returned: 0 in 0.571s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:31:59 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b12494-27e6-471c-bd48-1394d292e391 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:31:59 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b12494-27e6-471c-bd48-1394d292e391 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 Apr 13 17:31:59 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:00 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.490s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:32:00 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Deleted volume successfully. Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-f331c01c-d761-41f9-a370-bd33ce7095ef tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-faff20da-a136-4c7f-885e-fc3d07261422-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:32:00 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b12494-27e6-471c-bd48-1394d292e391 -F qcow2 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733" returned: 0 in 0.475s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:00 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 is being set with open permissions: ugo+rw Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:00 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 Apr 13 17:32:00 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:00 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733" returned: 0 in 0.459s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:00 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.info Apr 13 17:32:00 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "cinder-1968b611-164e-4a8d-84c7-fa32115ebfc5-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-1968b611-164e-4a8d-84c7-fa32115ebfc5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "cinder-quobyte-1968b611-164e-4a8d-84c7-fa32115ebfc5" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-quobyte-1968b611-164e-4a8d-84c7-fa32115ebfc5" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea189fcb-6306-4835-9afe-e3acb7897932]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:32:00 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:00 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5 Apr 13 17:32:00 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:01 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.info" returned: 0 in 0.492s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:01 devstack cinder-volume[81998]: WARNING cinder.volume.drivers.remotefs [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.info is being set with open permissions: ugo+rw Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.info {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:01 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.info Apr 13 17:32:01 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:01 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5" returned: 0 in 0.511s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:01 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5 Apr 13 17:32:01 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:01 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.info" returned: 0 in 0.494s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.069s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:32:01 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-00c5ed83-6281-4ff1-9c3f-7e91adb95353 tempest-CinderUnicodeTest-1082838149 None] Create snapshot completed successfully Apr 13 17:32:01 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-1968b611-164e-4a8d-84c7-fa32115ebfc5" returned: 0 in 0.464s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-quobyte-1968b611-164e-4a8d-84c7-fa32115ebfc5" released by "delete_volume" :: held 1.003s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Created reservations ['7fdb1a2e-624a-4fc6-a803-f1dd653dc66b', '2fc58bbd-b1e7-4857-8dec-839bbbafe1ed', '235ae9be-ac03-4b4e-b01a-c75ff1da0e1d', '08062958-ab56-459c-bbcb-b5c61a32fac2'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:32:01 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:01 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:32:01 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:02 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.451s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:32:02 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Deleted volume successfully. Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-30eb2ce6-2bf5-46a5-bb07-a0f6421aadd2 tempest-SnapshotDependencyTests-327166059 None] Lock "cinder-1968b611-164e-4a8d-84c7-fa32115ebfc5-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "cinder-a3603d80-b763-42d3-a8c3-20b5b4d57733-delete_snapshot" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-a3603d80-b763-42d3-a8c3-20b5b4d57733-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "cinder-quobyte-95b12494-27e6-471c-bd48-1394d292e391" by "delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-quobyte-95b12494-27e6-471c-bd48-1394d292e391" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "cinder-quobyte-a3603d80-b763-42d3-a8c3-20b5b4d57733" by "_delete_snapshot" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-quobyte-a3603d80-b763-42d3-a8c3-20b5b4d57733" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Deleting offline snapshot a3603d80-b763-42d3-a8c3-20b5b4d57733 of volume 95b12494-27e6-471c-bd48-1394d292e391 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] snapshot_file for this snap is: volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 {{(pid=81998) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f413d573-4cbb-4159-b708-5247798dfc60]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:32:02 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:02 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 Apr 13 17:32:02 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:03 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733" returned: 0 in 0.556s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:03 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.remotefs [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95b12494-27e6-471c-bd48-1394d292e391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81998) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:32:03 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2287adc-c2e9-4617-aefc-d61d0225e468]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:32:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:03 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 Apr 13 17:32:03 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:03 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391" returned: 0 in 0.578s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:03 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:03 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 Apr 13 17:32:03 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:04 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733" returned: 0 in 0.474s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:04 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733 Apr 13 17:32:04 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:04 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:04 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391.a3603d80-b763-42d3-a8c3-20b5b4d57733" returned: 0 in 0.451s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-quobyte-a3603d80-b763-42d3-a8c3-20b5b4d57733" released by "_delete_snapshot" :: held 2.159s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:32:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-quobyte-95b12494-27e6-471c-bd48-1394d292e391" released by "delete_snapshot" :: held 2.176s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:32:04 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Created reservations ['e1675c79-642b-42ad-b52c-56ac69476553', 'c2818b45-a86e-46c3-8d02-62bc1397f2ba', 'e4ebf03d-10b7-47a4-b298-a041272a27b8', 'e0473c7f-41f2-4064-9619-83b829275051'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:32:04 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Delete snapshot completed successfully. Apr 13 17:32:04 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-d9073eff-7397-4e02-aab1-ab0b1052e200 tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-a3603d80-b763-42d3-a8c3-20b5b4d57733-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:32:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "cinder-95b12494-27e6-471c-bd48-1394d292e391-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:32:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-95b12494-27e6-471c-bd48-1394d292e391-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:32:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "cinder-quobyte-95b12494-27e6-471c-bd48-1394d292e391" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:32:05 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-quobyte-95b12494-27e6-471c-bd48-1394d292e391" acquired by "delete_volume" :: waited 0.024s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:32:05 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2480a0e-0a71-41b5-92bb-f06ef50e6ca6]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:32:05 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:06 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 Apr 13 17:32:06 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:06 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391" returned: 0 in 0.589s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:06 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:06 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391 Apr 13 17:32:06 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:07 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-95b12494-27e6-471c-bd48-1394d292e391" returned: 0 in 0.491s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:07 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-quobyte-95b12494-27e6-471c-bd48-1394d292e391" released by "delete_volume" :: held 1.115s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:32:07 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Created reservations ['156bed5e-32f2-4682-a62c-110cf1b8bb54', '922494c5-fd66-4a11-9a55-67cde659e56f', '53c0edb7-d3eb-421a-91ac-d17fa56079c3', '14d4b13c-8fbe-46a6-ab0e-2cf3f3d4b5f7'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:32:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:32:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:32:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:32:07 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:32:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:32:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:07 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:32:07 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:07 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:07 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.506s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:07 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:32:07 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Deleted volume successfully. Apr 13 17:32:07 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-0be4a40b-d30c-4380-a992-24f5a4cf11f0 tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-95b12494-27e6-471c-bd48-1394d292e391-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:32:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "cinder-e1065f22-1ff4-478a-a306-02138231c098-delete_volume" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:32:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-e1065f22-1ff4-478a-a306-02138231c098-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:32:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "cinder-quobyte-e1065f22-1ff4-478a-a306-02138231c098" by "delete_volume" {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:32:08 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-quobyte-e1065f22-1ff4-478a-a306-02138231c098" acquired by "delete_volume" :: waited 0.011s {{(pid=81998) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:32:08 devstack cinder-volume[81998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a222316-2fe4-46fc-9e25-fe185f433a1f]: (4, 'qcow2') {{(pid=82711) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:32:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e1065f22-1ff4-478a-a306-02138231c098 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:08 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e1065f22-1ff4-478a-a306-02138231c098 Apr 13 17:32:08 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:08 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e1065f22-1ff4-478a-a306-02138231c098" returned: 0 in 0.607s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:08 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e1065f22-1ff4-478a-a306-02138231c098 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:08 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e1065f22-1ff4-478a-a306-02138231c098 Apr 13 17:32:08 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:09 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686/volume-e1065f22-1ff4-478a-a306-02138231c098" returned: 0 in 0.494s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:09 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-quobyte-e1065f22-1ff4-478a-a306-02138231c098" released by "delete_volume" :: held 1.128s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:32:09 devstack cinder-volume[81998]: DEBUG cinder.quota [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Created reservations ['589705c7-c349-4b26-91b8-a05fc6cb6d1b', 'bec85b19-b8e4-4151-9f72-f6037e79f6f1', '88bafd9b-8e13-487e-a04e-d7071d30785b', 'be2ed101-f779-44b9-92e8-5cd9b588cff4'] {{(pid=81998) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:32:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:32:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:32:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6': None} {{(pid=81998) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:32:09 devstack cinder-volume[81998]: DEBUG cinder.volume.drivers.quobyte [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61e04dbf-cdc8-4d6b-9095-82c24540afe6'] {{(pid=81998) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:32:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.lockutils [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:32:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:32:09 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686 Apr 13 17:32:09 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:32:09 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 13 17:32:09 devstack cinder-volume[81998]: DEBUG oslo_concurrency.processutils [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/abf89dba61bd2df9e42921b6f1fb7686" returned: 0 in 0.494s {{(pid=81998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:32:09 devstack cinder-volume[81998]: DEBUG cinder.manager [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Notifying Schedulers of capabilities ... {{(pid=81998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:32:09 devstack cinder-volume[81998]: INFO cinder.volume.manager [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Deleted volume successfully. Apr 13 17:32:09 devstack cinder-volume[81998]: DEBUG cinder.coordination [None req-00d9d8f4-58d3-4488-a83a-f8d1685c594b tempest-CinderUnicodeTest-1082838149 None] Lock "cinder-e1065f22-1ff4-478a-a306-02138231c098-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=81998) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:32:19 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:UPDATE=63,cinder:SELECT=45,cinder:INSERT=20,cinder:DELETE=3 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:32:19 devstack cinder-volume[81998]: DEBUG dbcounter [-] [81998] Writing DB stats cinder:UPDATE=113,cinder:DELETE=11,cinder:SELECT=69,cinder:INSERT=23 {{(pid=81998) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}